-- Logs begin at Wed 2022-08-17 15:09:19 UTC, end at Wed 2022-08-17 16:29:13 UTC. -- Aug 17 16:01:48.741928 dv-osbrick-836057-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 16:01:48.749304 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 16:01:48 2022] *** Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: nodename: dv-osbrick-836057-4-ceph Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: machine: x86_64 Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: clock source: unix Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: pcre jit disabled Aug 17 16:01:48.751328 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: detected number of CPU cores: 4 Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: current working directory: / Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: detected binary path: /usr/bin/uwsgi-core Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: your processes number limit is 47680 Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: your memory page size is 4096 bytes Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: detected max file descriptor number: 2048 Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: lock engine: pthread robust mutexes Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: thunder lock: enabled Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 16:01:48.751828 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 16:01:48.798492 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: Python main interpreter initialized at 0x558938d069c0 Aug 17 16:01:48.798492 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: python threads support enabled Aug 17 16:01:48.798492 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: your server socket listen backlog is limited to 100 connections Aug 17 16:01:48.798492 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: your mercy for graceful operations on workers is 90 seconds Aug 17 16:01:48.798890 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 16:01:48.798969 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: *** Operational MODE: preforking *** Aug 17 16:01:48.799198 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: *** uWSGI is running in multiple interpreter mode *** Aug 17 16:01:48.799198 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: spawned uWSGI master process (pid: 88418) Aug 17 16:01:48.799407 dv-osbrick-836057-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 17 16:01:48.800000 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: spawned uWSGI worker 1 (pid: 88431, cores: 1) Aug 17 16:01:48.803536 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: spawned uWSGI worker 2 (pid: 88432, cores: 1) Aug 17 16:01:48.803536 dv-osbrick-836057-4-ceph devstack@keystone.service[88418]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 16:01:53.442884 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:53.442884 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: from cryptography.utils import int_from_bytes Aug 17 16:01:53.443652 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:53.443652 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: from cryptography.utils import int_from_bytes Aug 17 16:01:53.444547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:53.444547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: from cryptography.utils import int_from_bytes Aug 17 16:01:53.445002 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 16:01:53.445002 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: from cryptography.utils import int_from_bytes Aug 17 16:01:53.493296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:01:53.493506 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:01:53.493678 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] command line args: [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:01:53.493945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:01:53.494076 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 16:01:53.494163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ================================================================================ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:01:53.494270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 16:01:53.494349 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] admin_token = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.494461 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] command line args: [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 16:01:53.494588 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config_dir = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.494727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 16:01:53.494810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.494904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ================================================================================ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 16:01:53.494979 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] config_source = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495102 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] debug = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] admin_token = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config_dir = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495731 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] config_source = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495867 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.495950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] debug = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.496076 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.496175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.496309 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.496429 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497120 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497199 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_config_append = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497518 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_dir = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.497919 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498085 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_config_append = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498436 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_dir = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.498959 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499016 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499382 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499502 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499586 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499695 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499808 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.499928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500037 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500153 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500271 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500380 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500540 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500662 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.500904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501020 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501253 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501408 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501530 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501785 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.501901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.502035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] publish_errors = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.502200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.502375 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.502539 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.502700 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] publish_errors = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.502858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.503014 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.503165 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.503326 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.503521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.503697 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.503883 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] standard_threads = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.504057 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.504204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.504365 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.504521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.504678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] standard_threads = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.504828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.504828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_journal = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.505078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.505354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_json = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.505510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.505633 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_stderr = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.505746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.505862 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] use_syslog = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.505978 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_journal = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.506097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.506209 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_json = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.506209 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_stderr = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.506422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.506531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] use_syslog = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.506646 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.506765 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 16:01:53.506876 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.506984 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507099 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507215 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507336 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507833 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.507970 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508076 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508367 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508497 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508723 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.508944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509161 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509534 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.509886 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510121 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510757 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.510986 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511095 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511210 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511436 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511546 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511661 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511776 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.511892 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512032 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512567 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512678 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.512906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513016 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513246 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513410 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513642 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513759 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513869 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.513978 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514095 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.514885 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515067 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515416 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.515964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516589 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516698 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516698 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.516909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517143 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517875 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.517992 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518102 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518321 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518438 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518549 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518659 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518984 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.518984 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519306 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519868 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.519985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520311 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520425 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.520870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521080 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521199 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521310 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521478 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521592 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.521944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522174 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522626 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522736 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.522973 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523085 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523312 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523429 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523551 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523662 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523773 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.523890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.524250 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.524365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.524484 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.524597 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.524714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.524826 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.524943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525174 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525439 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.525894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526010 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526249 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526591 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526703 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526813 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.526929 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.527041 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.527159 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.527271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.527382 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.527492 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.527619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.528276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.528565 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.528745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.528851 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.528986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529102 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529208 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529311 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529478 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529829 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.529940 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530051 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530628 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530738 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530849 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.530968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531080 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531190 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531190 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531404 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.external = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.531961 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532071 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.password = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.external = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] auth.token = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532801 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.532916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533030 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533267 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.password = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533542 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] auth.token = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533764 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.533887 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534000 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534221 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534444 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534562 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.534910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535363 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535473 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535583 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535583 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535790 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.535909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536022 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536143 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.536921 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537032 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537144 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537508 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537729 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.537963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538187 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538507 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538738 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.538950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539172 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539404 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539625 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539736 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539846 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.539846 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540063 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540063 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540272 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540272 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540471 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540471 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.540910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541817 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.541817 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542215 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542326 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542438 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.542981 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.543093 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.543219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.543952 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544585 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544585 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544804 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.544915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545026 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545137 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545395 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545509 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.545830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546054 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546165 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546387 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546498 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546667 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546799 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.546913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547024 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547369 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547601 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547826 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.547943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548064 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548643 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548877 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.548989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549100 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549210 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549379 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549506 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.549967 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550077 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550293 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550388 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550497 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.550955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551165 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551737 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.551960 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552071 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552189 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552867 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552980 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.552980 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.553188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.553303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.553444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.553444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.553668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.553779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.553890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554002 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554239 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554464 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554575 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554686 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554804 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.554924 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555037 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555148 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555589 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555706 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555929 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.555929 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556259 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556369 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556480 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556591 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.556934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557802 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.557914 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558137 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558480 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558591 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558812 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.558985 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.559147 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.559263 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.559375 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.559513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.559675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.559801 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.559915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560028 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560253 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560364 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560597 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.560920 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561031 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561150 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561264 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561522 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561744 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.561982 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562205 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562758 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.562981 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563883 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.563996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.564924 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565207 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.565948 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566068 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566293 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566628 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.566972 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567538 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567650 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567761 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567873 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.567992 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568105 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568328 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568439 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568671 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568785 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.568896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569118 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569833 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.569944 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570063 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570177 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570399 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570622 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.570966 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571077 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571418 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571643 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571866 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.571977 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572209 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572430 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572541 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572777 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.572889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573000 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573111 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573392 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573877 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.573988 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.574122 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.574288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.574402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.574580 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.574721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.574838 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.574961 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575753 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575865 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.575978 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576089 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576201 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576320 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576642 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576762 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576883 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.576997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577109 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577232 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577387 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577737 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.577959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578869 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.578980 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579092 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579316 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579661 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579883 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.579994 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580339 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580562 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580666 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580784 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.580897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.581008 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:01:53.581120 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.581120 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 16:01:53.581120 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 16:01:53.609712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.609932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.610099 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.610183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.610331 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.610557 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.618904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.619140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.647080 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.647305 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.648166 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.648400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.702061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.702213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.751276 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.751506 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.751944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.752180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.819350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.819583 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.819583 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.819814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.819900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.819978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.820053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.820126 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.820209 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.820286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.820384 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.820467 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844862 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.844957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.845081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.845165 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.845296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.845396 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.845533 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.845619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.856767 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.857001 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.869345 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.869589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.869692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.869810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.869895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870032 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870115 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870336 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88431) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870775 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.870914 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88432) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 16:01:53.888518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.888721 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:53.888935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.889061 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.889146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:53.889261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:53.889496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.889580 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.889695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 16:01:53.889820 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.889969 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.890082 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.890231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.890340 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.890496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.890754 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.899996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.900270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.900543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.900642 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.900825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.900909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.901168 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.901490 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.907786 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.909295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.910672 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.910954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.911238 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.911524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.911809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.912076 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.912199 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.912348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.912486 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.912623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.912776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.912895 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.913059 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.913180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.913360 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.913455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.913626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.913896 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.914170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.914441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.914717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.914987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.938826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.938950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.940289 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.940374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.940573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.940655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.945074 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.945168 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.945381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.945480 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.945785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.947339 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.952391 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.952624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.953935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.954222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.956642 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.956942 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.957226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.957650 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.957947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.958228 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.958308 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.958514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.958594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.958795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.958878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.959224 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.959512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.959791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.960085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.960363 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.974343 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.974627 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.975968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.976250 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.978474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.980109 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.984054 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.984054 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.984353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.984353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.986728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.988564 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.989874 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.991704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:53.992945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.993248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.993564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.993975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.994269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.994563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.994825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.995129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.995416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.995810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.996093 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:53.996445 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.010817 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.011107 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.011378 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.011641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.012801 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.013084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.013376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.013654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.018424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.020069 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.020352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.020475 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.022029 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.022317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.023027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.023325 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.023612 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.023912 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.024450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.025202 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.025518 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.025805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.026099 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.026406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.035750 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.036037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.036323 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.036608 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.036915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.037204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.037509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.037669 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.037951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.038232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.038514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.038805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.039080 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.039366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.053310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.055301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.056216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.058232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.059829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.061391 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.061821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.062855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.063140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.063264 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.063433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.064773 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.065058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.065448 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.069868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.071303 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.071872 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.073378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.074203 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.074524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.074910 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.075171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.076400 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.076695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.076983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.077269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.083962 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.084252 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.084537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.085158 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.085472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.085758 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.091286 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88431) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.091672 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.091959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.092245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.092480 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88432) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 16:01:54.092619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.092795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.093073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.093363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.093648 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.093781 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.093917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094047 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094320 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094868 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.094996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88431) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.095131 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.095384 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.095657 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.095944 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.096218 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.096495 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.096778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.097038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88432) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 16:01:54.128695 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558938d069c0 pid: 88431 (default app) Aug 17 16:01:54.130787 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558938d069c0 pid: 88432 (default app) Aug 17 16:01:54.132086 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b9b0-d32a-4d47-b5c3-3fd48040c330 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:01:54.132371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b9b0-d32a-4d47-b5c3-3fd48040c330 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:01:54.132644 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740b9b0-d32a-4d47-b5c3-3fd48040c330 None None] PATH_INFO: `/v3` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:01:54.136771 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Wed Aug 17 16:01:54 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:01.265182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cf64-59ab-416c-85ac-38434a868169 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.265705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cf64-59ab-416c-85ac-38434a868169 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.265705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cf64-59ab-416c-85ac-38434a868169 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.269989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:01.275544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:01.275900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:01.276078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:01.351745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: INFO dbcounter [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] Registered counter for database keystone Aug 17 16:02:01.370428 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG oslo_db.sqlalchemy.engines [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:02:01.377280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writer thread running {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:02:01.556100 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG passlib.handlers.bcrypt [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88431) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 16:02:01.556436 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG passlib.handlers.bcrypt [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88431) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 16:02:01.611442 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:01.613037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:01.742261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 16:02:02.258395 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cf64-59ab-416c-85ac-38434a868169 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.334335 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: INFO dbcounter [None req-cba6cf64-59ab-416c-85ac-38434a868169 None None] Registered counter for database keystone Aug 17 16:02:02.356906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG oslo_db.sqlalchemy.engines [None req-cba6cf64-59ab-416c-85ac-38434a868169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 16:02:02.363273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writer thread running {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 16:02:02.485257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cf64-59ab-416c-85ac-38434a868169 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.489499 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9933ac-0a88-4093-abc9-8453cbfc5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.490100 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9933ac-0a88-4093-abc9-8453cbfc5c46 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.490372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9933ac-0a88-4093-abc9-8453cbfc5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.490634 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9933ac-0a88-4093-abc9-8453cbfc5c46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.499011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9933ac-0a88-4093-abc9-8453cbfc5c46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.551394 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4a9933ac-0a88-4093-abc9-8453cbfc5c46 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 16:02:02.551673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9933ac-0a88-4093-abc9-8453cbfc5c46 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.561563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 16:02:02.567533 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:02.584614 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d8cff-9617-4d84-9ca2-82598d9ef937 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:02.589083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e21a8-0f6f-46d0-9151-d0bbce3731a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:02.590243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e21a8-0f6f-46d0-9151-d0bbce3731a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:02.590587 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e21a8-0f6f-46d0-9151-d0bbce3731a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:02.590872 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e21a8-0f6f-46d0-9151-d0bbce3731a5 admin admin] PATH_INFO: `/v3/projects/35b16f4dab55413091c1b8347836e133` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:02.592306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e21a8-0f6f-46d0-9151-d0bbce3731a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=35b16f4dab55413091c1b8347836e133)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:02.643052 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c9e21a8-0f6f-46d0-9151-d0bbce3731a5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 16:02:02.643392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e21a8-0f6f-46d0-9151-d0bbce3731a5 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:02.647950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Wed Aug 17 16:02:02 2022] GET /identity/v3/projects/35b16f4dab55413091c1b8347836e133 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:04.791317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f41da-1f46-4a7b-8bc5-c6e9f6c560cc None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:04.791890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f41da-1f46-4a7b-8bc5-c6e9f6c560cc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:04.791890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f41da-1f46-4a7b-8bc5-c6e9f6c560cc None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:04.796133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:04.801775 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea97e0-7d42-4401-b67b-46bc07ca8552 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:04.802180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea97e0-7d42-4401-b67b-46bc07ca8552 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:04.802310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea97e0-7d42-4401-b67b-46bc07ca8552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:04.822395 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bbea97e0-7d42-4401-b67b-46bc07ca8552 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:04.823892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bbea97e0-7d42-4401-b67b-46bc07ca8552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:04.832441 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 16:02:05.157582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f41da-1f46-4a7b-8bc5-c6e9f6c560cc None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:05.170158 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f41da-1f46-4a7b-8bc5-c6e9f6c560cc None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:05.174271 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0857106-cbf0-4c0c-838b-4951c8b0ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:05.174849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857106-cbf0-4c0c-838b-4951c8b0ce8c admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.175121 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857106-cbf0-4c0c-838b-4951c8b0ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.175388 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857106-cbf0-4c0c-838b-4951c8b0ce8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.183001 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0857106-cbf0-4c0c-838b-4951c8b0ce8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:05.184945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0857106-cbf0-4c0c-838b-4951c8b0ce8c admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:05.193830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 17 16:02:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 16:02:05.199785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea97e0-7d42-4401-b67b-46bc07ca8552 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:05.208899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea97e0-7d42-4401-b67b-46bc07ca8552 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:05.213256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60dada-8a67-4e14-8b9d-684251e42727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:05.213947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60dada-8a67-4e14-8b9d-684251e42727 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:05.214234 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60dada-8a67-4e14-8b9d-684251e42727 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:05.214512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60dada-8a67-4e14-8b9d-684251e42727 admin admin] PATH_INFO: `/v3/users/3a6faffef1254eafa180a1020d50a19a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:05.216452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60dada-8a67-4e14-8b9d-684251e42727 admin admin] RBAC: Authorizing `identity:get_user(user_id=3a6faffef1254eafa180a1020d50a19a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:05.218318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60dada-8a67-4e14-8b9d-684251e42727 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:05.219837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Wed Aug 17 16:02:05 2022] GET /identity/v3/users/3a6faffef1254eafa180a1020d50a19a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:07.475591 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385af1c-fd12-4f5d-8bb0-840f0a258c8e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.476174 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385af1c-fd12-4f5d-8bb0-840f0a258c8e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.476174 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385af1c-fd12-4f5d-8bb0-840f0a258c8e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.477652 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:07.483232 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87e9a9-5c94-4cfb-867d-0c2ba5fe0135 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.483690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87e9a9-5c94-4cfb-867d-0c2ba5fe0135 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.483785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87e9a9-5c94-4cfb-867d-0c2ba5fe0135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.499372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f02794-e73e-4ae2-a252-86666e621893 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.499759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f02794-e73e-4ae2-a252-86666e621893 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.500041 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f02794-e73e-4ae2-a252-86666e621893 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.501388 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:07.502006 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4c87e9a9-5c94-4cfb-867d-0c2ba5fe0135 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:07.503184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4c87e9a9-5c94-4cfb-867d-0c2ba5fe0135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:07.506690 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:07.506974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:07.507245 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:07.549258 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG passlib.handlers.bcrypt [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88432) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 16:02:07.549697 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG passlib.handlers.bcrypt [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88432) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 16:02:07.596086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:07.597766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:07.697165 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:07.704450 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:08.026505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87e9a9-5c94-4cfb-867d-0c2ba5fe0135 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.033079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.052340 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.134105 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87e9a9-5c94-4cfb-867d-0c2ba5fe0135 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.139710 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922165c8-852f-45d7-ba43-700544b4f801 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.142022 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.170239 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.170958 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.171303 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.171649 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.178197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.179038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.179318 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.179584 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.182711 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:08.191470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:08.192359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:08.193181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:08.198453 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.249827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.251288 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.280654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.299837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f4bf0-7013-4fbd-bb1d-8b23372cb32d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.333374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.333971 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.334245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.334514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.335173 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:08.335468 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.336848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.348896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:08.350878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:08.354657 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.357427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.361291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.461812 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a934c-cf1b-442a-905d-2115ef0ea6e2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.467029 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4782d-6ec9-4746-ab71-32585e2da32b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.496871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.497516 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.497794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.498060 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] PATH_INFO: `/v3/users/3a6faffef1254eafa180a1020d50a19a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.499194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6faffef1254eafa180a1020d50a19a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.500696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.502473 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/users/3a6faffef1254eafa180a1020d50a19a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:08.503347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.504213 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.504549 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.504821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.507728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.525449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.526755 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.527301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:08.548553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:08.549664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:08.550443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:08.550443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:08.550443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:08.550443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 9/18] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:08.555332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.616251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b65c0-9ba5-4fee-8a1d-346e3bad0c12 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.653446 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.654093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.654370 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.654641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.655816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.657304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.658927 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 10/19] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:08.664655 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:08.726687 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.746176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:08.765721 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b664fee6-90f6-43f2-ade1-4bfb72066abc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.770689 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d1a4d7-8592-4af6-a41c-d3bfb4a6dfe1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:08.801562 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bc3b3-3ca5-4ada-97ca-36a00e9ebd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.802167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bc3b3-3ca5-4ada-97ca-36a00e9ebd9f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.802449 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bc3b3-3ca5-4ada-97ca-36a00e9ebd9f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.802880 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bc3b3-3ca5-4ada-97ca-36a00e9ebd9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.803471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bc3b3-3ca5-4ada-97ca-36a00e9ebd9f None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.domain.id=default, user.id=3a6faffef1254eafa180a1020d50a19a) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:08.803846 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bc3b3-3ca5-4ada-97ca-36a00e9ebd9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.805301 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bc3b3-3ca5-4ada-97ca-36a00e9ebd9f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.807882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2f94f-0e99-4517-ab9f-72281a9d7035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:08.808474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2f94f-0e99-4517-ab9f-72281a9d7035 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:08.808793 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2f94f-0e99-4517-ab9f-72281a9d7035 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:08.809063 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2f94f-0e99-4517-ab9f-72281a9d7035 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:08.809729 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2f94f-0e99-4517-ab9f-72281a9d7035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:08.810028 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2f94f-0e99-4517-ab9f-72281a9d7035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:08.811404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2f94f-0e99-4517-ab9f-72281a9d7035 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:08.816163 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/role_assignments?user.id=3a6faffef1254eafa180a1020d50a19a&scope.domain.id=default&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:08.830426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:11.360094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2ba24-b35c-4b97-a6ba-29dd66b51b32 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.360584 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2ba24-b35c-4b97-a6ba-29dd66b51b32 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.360584 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2ba24-b35c-4b97-a6ba-29dd66b51b32 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.361899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:11.379008 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba035e-a9a3-4510-8c0e-502eddf4723e None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.379941 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba035e-a9a3-4510-8c0e-502eddf4723e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.380410 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba035e-a9a3-4510-8c0e-502eddf4723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.402338 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2cba035e-a9a3-4510-8c0e-502eddf4723e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:11.404427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2cba035e-a9a3-4510-8c0e-502eddf4723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:11.493847 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab76f4-be82-466b-b111-0c6e75e6d220 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.494481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab76f4-be82-466b-b111-0c6e75e6d220 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.494952 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab76f4-be82-466b-b111-0c6e75e6d220 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.497109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 13/23] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:11.498688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:11.514514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c124-75b1-4dec-bf72-08820cc27bab None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:11.515230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c124-75b1-4dec-bf72-08820cc27bab None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:11.515723 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb1c124-75b1-4dec-bf72-08820cc27bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:11.542595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-6eb1c124-75b1-4dec-bf72-08820cc27bab None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:11.544782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-6eb1c124-75b1-4dec-bf72-08820cc27bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:11.625184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:12.063440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432de92-5092-4434-a781-bf7aa5cb9131 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.064060 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432de92-5092-4434-a781-bf7aa5cb9131 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.064530 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432de92-5092-4434-a781-bf7aa5cb9131 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.066176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 12/26] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:12.071667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dcf1-67b2-4461-a6e0-23f06dd570f8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.071956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dcf1-67b2-4461-a6e0-23f06dd570f8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.072233 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f8dcf1-67b2-4461-a6e0-23f06dd570f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.096283 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20859ec-ef61-41c2-bb0b-696faac28376 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.096591 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20859ec-ef61-41c2-bb0b-696faac28376 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.096827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20859ec-ef61-41c2-bb0b-696faac28376 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.098174 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:12.099581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20859ec-ef61-41c2-bb0b-696faac28376 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.101145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c1f8dcf1-67b2-4461-a6e0-23f06dd570f8 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:12.102391 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c1f8dcf1-67b2-4461-a6e0-23f06dd570f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:12.184177 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.227304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 15/28] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:12.228566 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b10e4-6797-4d43-9066-297416eddf5d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.228848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b10e4-6797-4d43-9066-297416eddf5d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.229118 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b10e4-6797-4d43-9066-297416eddf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.240819 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.259918 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a40b10e4-6797-4d43-9066-297416eddf5d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:12.261102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a40b10e4-6797-4d43-9066-297416eddf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:12.307905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20859ec-ef61-41c2-bb0b-696faac28376 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.363821 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 16/29] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:12.365380 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b10e4-6797-4d43-9066-297416eddf5d None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.395702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.397999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.400171 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.400656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.413852 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.415615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:02:12.446427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:12.447316 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:02:12.448105 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:02:12.448105 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:02:12.448105 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:12.451024 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 14/30] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:12.456382 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.508953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b10e4-6797-4d43-9066-297416eddf5d None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.579408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.580058 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.580339 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.580612 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.586986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.604602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c851c-1597-4ac8-9af6-52fd98b0d95b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.617813 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.617973 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:12.623434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:12.624333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:12.625088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:12.631216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 17/31] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:12.631216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.674037 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.674665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.674944 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.675217 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.675871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:12.676231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.677648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.698933 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 15/32] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:12.700443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.750531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d32e0-c1a7-4eb3-9966-df3002402b14 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.802269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.802823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.803103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.803377 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.804055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.805508 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.847409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5c0e6-d78e-4b4b-a089-7a52c562ea74 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:12.884858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:12.885509 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:12.885787 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:12.886058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:12.887317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:12.887625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:12.889010 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:12.902569 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 16/33] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:12.903396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:12.928037 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:12.963273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 18/34] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 17 16:02:12 2022] POST /identity/v3/roles => generated 225 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:12.964343 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.030461 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.031613 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9399-05ce-481a-ae1f-00f215cc9cbe None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.078555 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d243815-b492-4042-b3fe-74b264550174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.079513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243815-b492-4042-b3fe-74b264550174 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.079988 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243815-b492-4042-b3fe-74b264550174 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.080455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d243815-b492-4042-b3fe-74b264550174 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.081624 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d243815-b492-4042-b3fe-74b264550174 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.083345 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d243815-b492-4042-b3fe-74b264550174 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.108975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055aa51-17f7-4aab-a969-803c0d65bad4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.156390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.157508 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.158013 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.158484 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.159420 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.161206 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.178980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 19/35] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 17 16:02:12 2022] POST /identity/v3/roles => generated 219 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:13.180383 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.275411 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 17/36] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:02:12 2022] POST /identity/v3/projects => generated 301 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:13.277152 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736d2a4-a3cc-4103-9fd9-1a9f5323dfc0 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.278079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736d2a4-a3cc-4103-9fd9-1a9f5323dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.278365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736d2a4-a3cc-4103-9fd9-1a9f5323dfc0 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.279938 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 18/37] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:13.286647 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770c92-c14a-4c43-b493-c3dfeccbee40 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.287023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770c92-c14a-4c43-b493-c3dfeccbee40 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.287214 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85770c92-c14a-4c43-b493-c3dfeccbee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.311229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-85770c92-c14a-4c43-b493-c3dfeccbee40 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:13.312885 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-85770c92-c14a-4c43-b493-c3dfeccbee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:13.329194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70c516-89c4-42c2-9d66-bc5127d4b254 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.353747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.380572 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.382974 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.383542 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.384053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] PATH_INFO: `/v3/users/3a6faffef1254eafa180a1020d50a19a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.385825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6faffef1254eafa180a1020d50a19a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.388418 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.390822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/users/3a6faffef1254eafa180a1020d50a19a => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:13.396991 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.478673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 19/39] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:13.529837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4fd4c-b149-4337-9c46-514c9f82d3f7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.571020 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.571667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.571945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.572215 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.573509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.575031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.576756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 21/40] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:13.578402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888194-97f2-4768-a957-42716d8e154a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.578695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888194-97f2-4768-a957-42716d8e154a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.578975 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21888194-97f2-4768-a957-42716d8e154a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.580374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 20/41] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:13.582526 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.585851 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad453-b2a6-4a29-9c59-ece9aa4dec93 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.586147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad453-b2a6-4a29-9c59-ece9aa4dec93 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.586430 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acad453-b2a6-4a29-9c59-ece9aa4dec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.593617 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.610873 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-9acad453-b2a6-4a29-9c59-ece9aa4dec93 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:13.612092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-9acad453-b2a6-4a29-9c59-ece9aa4dec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:13.650944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:13.698021 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 21/42] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:13.717161 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1026c-093f-4e50-9dc7-4ab7de6648ac None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:13.760594 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:13.761276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:13.761595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:13.761930 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] PATH_INFO: `/v3/domains/default/users/3a6faffef1254eafa180a1020d50a19a/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:13.763914 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3a6faffef1254eafa180a1020d50a19a, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:13.765483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:13.780367 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 22/43] 10.222.0.47 () {58 vars in 1361 bytes} [Wed Aug 17 16:02:13 2022] PUT /identity/v3/domains/default/users/3a6faffef1254eafa180a1020d50a19a/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:13.869745 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acad453-b2a6-4a29-9c59-ece9aa4dec93 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:13.995608 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acad453-b2a6-4a29-9c59-ece9aa4dec93 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.030414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.036563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.037183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.037542 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.037825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.038704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:14.040597 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.055439 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.058144 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 22/44] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 17 16:02:13 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:14.220124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f7d27-138b-4db7-a894-b8a1fe0cfe05 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.241428 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:14.276660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588e0bb-2a97-4d60-9b8e-09f080ec299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.278016 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e0bb-2a97-4d60-9b8e-09f080ec299c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.278376 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e0bb-2a97-4d60-9b8e-09f080ec299c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.278726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588e0bb-2a97-4d60-9b8e-09f080ec299c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.279980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588e0bb-2a97-4d60-9b8e-09f080ec299c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:14.281589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588e0bb-2a97-4d60-9b8e-09f080ec299c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.283248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 23/45] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:14.288875 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:14.394544 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2750a07-9fc7-483b-b3fc-d503da397837 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:14.430167 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e5189a-0a9d-4178-9781-f721aee65e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:14.430775 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5189a-0a9d-4178-9781-f721aee65e8a None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:14.431052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5189a-0a9d-4178-9781-f721aee65e8a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:14.431326 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e5189a-0a9d-4178-9781-f721aee65e8a None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:14.431961 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5189a-0a9d-4178-9781-f721aee65e8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:14.433461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e5189a-0a9d-4178-9781-f721aee65e8a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:14.460347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 23/46] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:02:14 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:16.048728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959edd-a352-4742-b598-aec5c28a7599 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.049255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959edd-a352-4742-b598-aec5c28a7599 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.049796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e959edd-a352-4742-b598-aec5c28a7599 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.051342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 24/47] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:16.056680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3f060-f288-4e82-befa-1e864629c17c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.057124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3f060-f288-4e82-befa-1e864629c17c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.057213 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3f060-f288-4e82-befa-1e864629c17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.076446 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ccc3f060-f288-4e82-befa-1e864629c17c None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:16.077675 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ccc3f060-f288-4e82-befa-1e864629c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:16.116507 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.144460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:16.475244 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959edd-a352-4742-b598-aec5c28a7599 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.581874 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e959edd-a352-4742-b598-aec5c28a7599 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.614902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.615519 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.615798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.616066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.626473 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:16.631182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:16.632094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:16.632836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 25/49] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:16.638951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3f060-f288-4e82-befa-1e864629c17c None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.736991 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3f060-f288-4e82-befa-1e864629c17c None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.772751 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dac45-21fd-42b6-8e00-e3e51f10c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.773407 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dac45-21fd-42b6-8e00-e3e51f10c483 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.773689 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dac45-21fd-42b6-8e00-e3e51f10c483 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.773960 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dac45-21fd-42b6-8e00-e3e51f10c483 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.774914 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dac45-21fd-42b6-8e00-e3e51f10c483 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:16.775218 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dac45-21fd-42b6-8e00-e3e51f10c483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.776654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48dac45-21fd-42b6-8e00-e3e51f10c483 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.786711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 25/50] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.792629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.836964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:16.903943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abcce9-29df-4b54-812b-ce07a8f6e556 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:16.935453 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467512e8-1c8c-433a-b1f1-ad320042b399 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.935732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467512e8-1c8c-433a-b1f1-ad320042b399 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.936004 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467512e8-1c8c-433a-b1f1-ad320042b399 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.937348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 26/51] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:16.938341 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:16.939025 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.939307 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.939573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] PATH_INFO: `/v3/users/3a6faffef1254eafa180a1020d50a19a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.940699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6faffef1254eafa180a1020d50a19a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:16.942286 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:16.942386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2096-709f-4965-b05e-4a6e31f907e4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:16.942660 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2096-709f-4965-b05e-4a6e31f907e4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:16.942931 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f2096-709f-4965-b05e-4a6e31f907e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:16.947858 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 26/52] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/users/3a6faffef1254eafa180a1020d50a19a => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:16.949056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:16.962354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ac6f2096-709f-4965-b05e-4a6e31f907e4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:16.963529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ac6f2096-709f-4965-b05e-4a6e31f907e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:16.993973 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.032440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 27/53] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:17.057286 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4130c9-eb3c-4b17-9797-d909317a1ab4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.064117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.090836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.091454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.091732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.092011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.093148 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.094645 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.096198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 27/54] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:17.102006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2096-709f-4965-b05e-4a6e31f907e4 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.199711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f2096-709f-4965-b05e-4a6e31f907e4 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.233492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.234102 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.234386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.234663 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.235385 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.domain.id=default, user.id=3a6faffef1254eafa180a1020d50a19a) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:17.235694 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.237125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.245607 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 28/55] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/role_assignments?user.id=3a6faffef1254eafa180a1020d50a19a&scope.domain.id=default&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:17.361403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.467467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4443796b-bdb5-423c-b54c-731c6ef99551 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.500308 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccbbb2-25bb-4693-922a-01d03b6c66ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.500868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccbbb2-25bb-4693-922a-01d03b6c66ac None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.501149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccbbb2-25bb-4693-922a-01d03b6c66ac None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.501453 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccbbb2-25bb-4693-922a-01d03b6c66ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.502539 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccbbb2-25bb-4693-922a-01d03b6c66ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.503976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccbbb2-25bb-4693-922a-01d03b6c66ac None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.505564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 28/56] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:17.511379 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:17.542878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:17.611208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ab2c8-3ce7-403b-bba4-fd6ee533e615 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:17.644401 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5e863-17d9-4f4f-9a20-4b772862275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:17.644997 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5e863-17d9-4f4f-9a20-4b772862275a None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:17.645279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5e863-17d9-4f4f-9a20-4b772862275a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:17.645650 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5e863-17d9-4f4f-9a20-4b772862275a None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:17.646283 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5e863-17d9-4f4f-9a20-4b772862275a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:17.647720 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5e863-17d9-4f4f-9a20-4b772862275a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:17.672780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 29/57] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 17 16:02:17 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:19.847435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededf48-95c3-450a-8ed1-2823ec1087e5 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.847954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededf48-95c3-450a-8ed1-2823ec1087e5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.848041 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fededf48-95c3-450a-8ed1-2823ec1087e5 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.849312 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 29/58] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:19.854298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52143-3740-4ae0-81a5-a2884d602d31 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:19.854706 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52143-3740-4ae0-81a5-a2884d602d31 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:19.854849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f52143-3740-4ae0-81a5-a2884d602d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:19.874191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-03f52143-3740-4ae0-81a5-a2884d602d31 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:19.875370 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-03f52143-3740-4ae0-81a5-a2884d602d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:19.941897 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 30/59] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:20.267551 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededf48-95c3-450a-8ed1-2823ec1087e5 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:20.310937 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:20.367454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fededf48-95c3-450a-8ed1-2823ec1087e5 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:20.400444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a156154-7055-4a5b-b266-235b29d9593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:20.401047 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156154-7055-4a5b-b266-235b29d9593e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.401348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156154-7055-4a5b-b266-235b29d9593e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.401617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a156154-7055-4a5b-b266-235b29d9593e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.402854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a156154-7055-4a5b-b266-235b29d9593e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:20.404280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a156154-7055-4a5b-b266-235b29d9593e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:20.405830 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 30/60] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:20.411246 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52143-3740-4ae0-81a5-a2884d602d31 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:20.425585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:20.509265 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f52143-3740-4ae0-81a5-a2884d602d31 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:20.542209 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da13188-b37d-4e2b-8bcb-86a01c7d0f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:20.542754 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13188-b37d-4e2b-8bcb-86a01c7d0f63 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:20.543602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13188-b37d-4e2b-8bcb-86a01c7d0f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:20.543871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13188-b37d-4e2b-8bcb-86a01c7d0f63 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:20.544496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da13188-b37d-4e2b-8bcb-86a01c7d0f63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:20.545953 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da13188-b37d-4e2b-8bcb-86a01c7d0f63 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:20.570182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 31/61] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:20 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:24.007477 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870b95b-071c-4d86-966b-26a4a487d4a4 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.008447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870b95b-071c-4d86-966b-26a4a487d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.008917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870b95b-071c-4d86-966b-26a4a487d4a4 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.010787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 31/62] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:24.017696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca00c-8ca4-488b-a90f-4a1497dec641 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.018234 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca00c-8ca4-488b-a90f-4a1497dec641 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.018733 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1ca00c-8ca4-488b-a90f-4a1497dec641 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.020192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 32/63] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:24.021003 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad2ba-9f7f-4ebe-a29a-5105b8f7be35 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.021919 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad2ba-9f7f-4ebe-a29a-5105b8f7be35 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.022387 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ad2ba-9f7f-4ebe-a29a-5105b8f7be35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.025544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7ed4-abfc-44d8-a63d-603e2bf4209f None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.026037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7ed4-abfc-44d8-a63d-603e2bf4209f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.026517 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fe7ed4-abfc-44d8-a63d-603e2bf4209f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.050400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-18fe7ed4-abfc-44d8-a63d-603e2bf4209f None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:24.052261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-18fe7ed4-abfc-44d8-a63d-603e2bf4209f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:24.063151 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2d1ad2ba-9f7f-4ebe-a29a-5105b8f7be35 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:24.064964 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2d1ad2ba-9f7f-4ebe-a29a-5105b8f7be35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:24.186683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.188410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 33/64] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:24.200556 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 32/65] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:24.244597 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a495d81-d03f-4ce6-86f9-18f0d0a0e0a9 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.244887 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a495d81-d03f-4ce6-86f9-18f0d0a0e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.245075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a495d81-d03f-4ce6-86f9-18f0d0a0e0a9 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.246726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 34/66] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:24.251782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae943-34d0-499c-8653-9c8593e026c5 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.252071 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae943-34d0-499c-8653-9c8593e026c5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.252350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae943-34d0-499c-8653-9c8593e026c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.282644 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c76ae943-34d0-499c-8653-9c8593e026c5 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:24.283895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c76ae943-34d0-499c-8653-9c8593e026c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:24.375901 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 33/67] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:24.447625 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96eb5-bb5d-4281-9cd3-c0aef9ee3c34 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.447963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96eb5-bb5d-4281-9cd3-c0aef9ee3c34 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.448180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e96eb5-bb5d-4281-9cd3-c0aef9ee3c34 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.449704 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 35/68] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:24.454899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3995-627a-4f2e-9cbb-c4f70b870255 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.455188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3995-627a-4f2e-9cbb-c4f70b870255 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.455461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d3995-627a-4f2e-9cbb-c4f70b870255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.482375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ec1d3995-627a-4f2e-9cbb-c4f70b870255 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:24.483582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ec1d3995-627a-4f2e-9cbb-c4f70b870255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:24.543413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96eb5-bb5d-4281-9cd3-c0aef9ee3c34 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.582277 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 34/69] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:24.614990 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.663602 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e96eb5-bb5d-4281-9cd3-c0aef9ee3c34 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.698486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.699655 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.699936 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.700207 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.710779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:24.715977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:24.716825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:24.717610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:24.721446 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 36/70] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:24.723632 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d3995-627a-4f2e-9cbb-c4f70b870255 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.773295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.807670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.854593 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d3995-627a-4f2e-9cbb-c4f70b870255 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.883066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:24.886313 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdcc60-562d-48f5-be1b-a024d6ced536 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:24.892755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044664ed-6105-4025-83ca-351b7bc7a161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.893574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044664ed-6105-4025-83ca-351b7bc7a161 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.894023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044664ed-6105-4025-83ca-351b7bc7a161 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.894435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044664ed-6105-4025-83ca-351b7bc7a161 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.895247 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044664ed-6105-4025-83ca-351b7bc7a161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:24.895554 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044664ed-6105-4025-83ca-351b7bc7a161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:24.896927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044664ed-6105-4025-83ca-351b7bc7a161 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:24.906421 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:24.912045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebff6-fc95-4c5b-9900-7efb91996334 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.912342 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebff6-fc95-4c5b-9900-7efb91996334 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.912623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbebff6-fc95-4c5b-9900-7efb91996334 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.914083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 36/72] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:24.914724 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbebff6-fc95-4c5b-9900-7efb91996334 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:24.928357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:24.928990 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:24.929270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:24.929590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:24.942090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:24.946810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:24.947658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:24.948414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 37/73] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:24.949592 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.031644 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbebff6-fc95-4c5b-9900-7efb91996334 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.051184 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.063064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee92500-7f45-459d-be36-9a45a947c9cd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.065905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5075c-aac0-4eb4-9416-f4395ae09a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.066529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5075c-aac0-4eb4-9416-f4395ae09a0e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.066807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5075c-aac0-4eb4-9416-f4395ae09a0e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.067080 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5075c-aac0-4eb4-9416-f4395ae09a0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.078909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5075c-aac0-4eb4-9416-f4395ae09a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-bba5075c-aac0-4eb4-9416-f4395ae09a0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:25.085125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:25.086007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:25.087231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 37/74] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:25.088129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718401bd-dd8e-42f0-acea-09effdd91263 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.088129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718401bd-dd8e-42f0-acea-09effdd91263 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.088129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718401bd-dd8e-42f0-acea-09effdd91263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.100710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.101381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.101666 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.101939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] PATH_INFO: `/v3/users/3a6faffef1254eafa180a1020d50a19a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.103076 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6faffef1254eafa180a1020d50a19a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.104545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.104823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-718401bd-dd8e-42f0-acea-09effdd91263 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:25.106075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-718401bd-dd8e-42f0-acea-09effdd91263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:25.106187 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 38/75] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:24 2022] GET /identity/v3/users/3a6faffef1254eafa180a1020d50a19a => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.106871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.136349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.176587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 38/76] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:25.177455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718401bd-dd8e-42f0-acea-09effdd91263 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.228936 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9c4d4-d571-488e-a0d9-5c86a0511ad2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.266383 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.267002 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.267284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.267557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.268627 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:25.268945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.270654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.280766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 39/77] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.281938 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.289563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718401bd-dd8e-42f0-acea-09effdd91263 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.301730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.328974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.329558 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.329837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.330103 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.340920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:25.345680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:25.346523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:25.347278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 39/78] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:25.347920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.379201 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.388959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e956d7-732b-4044-9ef7-af4215851ad4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.431230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.433603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.433873 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.434273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.434802 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:25.435104 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.436505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.444887 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 40/79] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.450984 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.473552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150e363-2fe7-49f9-9805-904a1d7a51c5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.510110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.510723 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.511027 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.511304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.552659 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.555247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f025af-ea86-42ef-b81b-00e8fc07b21c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.581594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.583004 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.589270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.590613 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.590893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.591172 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.604227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.606474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.608078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 41/80] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.608842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.620226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.683933 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 40/81] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:25.684967 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.708710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c8912-7c2b-435d-a1ac-c2a6ec91c15d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.742316 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.742915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.743197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.743471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.744128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:25.744426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.745880 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.752363 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.754026 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 42/82] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.754831 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.786599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037fd7b-04d3-4da3-8df3-08f1b1c59863 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.821892 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.822507 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.822785 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.823057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.825251 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.826729 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.828324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 41/83] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.829075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.834148 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:25.864612 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2aa2e5-5338-4d67-83d2-ed54307c9c49 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.898745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.899368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.899899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.900167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.901382 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:25.903518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:25.905103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 43/84] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:25.905898 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:25.932512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97bedd-3c39-4d22-9ca7-57b5754476d8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:25.966665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:25.967264 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:25.967541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:25.967808 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:25.977302 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.007912 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41acd2-2c89-4677-8109-cd812d546342 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.036604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.038134 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.042186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.043503 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.043715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.043990 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.045138 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.046609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.048240 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 44/85] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:26.048995 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.059864 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.140035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 42/86] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:26.140806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.153530 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a697bd-9cc2-4a5a-8345-0094cc6a6b31 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.180528 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.187435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.188057 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.188342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.188615 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.189758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.191189 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.192743 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 45/87] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:26.193495 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.243558 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108d8dc-b99b-4ab4-8fec-a92bd69c09af None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.270582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.278276 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.278939 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.279212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.279479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.299046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532370-90c4-4390-8327-7aec79cbe1f4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.328397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.328985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.329259 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.329557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.330185 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.331626 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.354260 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.355974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.358801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 46/88] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:26 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:26.359616 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.405029 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.481689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438454c-4b44-48df-9cbb-57ab45fd3e24 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.489389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 43/89] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:26.491216 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.521928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.532355 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.533181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.533651 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.534110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.534854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=3a6faffef1254eafa180a1020d50a19a) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:26.535160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.537221 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.545484 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 47/90] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/role_assignments?user.id=3a6faffef1254eafa180a1020d50a19a&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:26.546467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.614805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9d119-0b0e-4f54-ac6a-d6009550f820 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.664269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.664269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.664269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.664269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.664623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.668200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.668200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 44/91] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:26.668200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:26.679233 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.689426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562db1c-6af0-4ebd-bd9b-33666ed19e91 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.734834 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.735812 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.736293 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.736763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.813237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214392a4-2c5b-4d52-9313-ef63fde01157 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:26.829191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:26.842861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.842861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.863827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:26.864468 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:26.864747 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:26.865024 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:26.866390 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:26.868462 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:26.870166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 45/92] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:26.870986 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.013124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 48/93] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:27.013709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:27.014033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.055076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c9704-7d95-4a66-aee0-b9771fc03fd0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.150332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.150958 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.151240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.151516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.151771 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:27.152437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=7541cbe0e8d54163bc5b518d916e8367) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:27.152755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.154441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.159278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca693d-75b2-47c1-babb-e7a5b27b5d2f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.168865 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 46/94] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:26 2022] GET /identity/v3/role_assignments?user.id=7541cbe0e8d54163bc5b518d916e8367&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:27.170237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.210190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.210821 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.211102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.211373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.212109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] RBAC: Adding query filter params (role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=7541cbe0e8d54163bc5b518d916e8367) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:27.212431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.213902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.220254 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 49/95] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/role_assignments?user.id=7541cbe0e8d54163bc5b518d916e8367&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:27.354979 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a75b34-7261-4e31-8146-10fbf3cd60d9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.404524 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2afac09-d021-4def-a7f3-585b45a39cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.405545 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afac09-d021-4def-a7f3-585b45a39cd3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.406023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afac09-d021-4def-a7f3-585b45a39cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.406492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2afac09-d021-4def-a7f3-585b45a39cd3 None admin] PATH_INFO: `/v3/projects/34cf970684624d9299889d407e03239a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.407861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afac09-d021-4def-a7f3-585b45a39cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=34cf970684624d9299889d407e03239a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.409680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2afac09-d021-4def-a7f3-585b45a39cd3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.411583 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 47/96] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/projects/34cf970684624d9299889d407e03239a => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:27.418537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:27.556169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a148633-5991-4b6f-aa4c-078d74e58dd2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:27.596356 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476b7dd-b415-42fe-bb40-a8ba5fd950e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:27.596964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476b7dd-b415-42fe-bb40-a8ba5fd950e1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:27.597314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476b7dd-b415-42fe-bb40-a8ba5fd950e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:27.597606 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476b7dd-b415-42fe-bb40-a8ba5fd950e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:27.598327 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476b7dd-b415-42fe-bb40-a8ba5fd950e1 None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=34cf970684624d9299889d407e03239a, user.id=7541cbe0e8d54163bc5b518d916e8367) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:27.598632 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476b7dd-b415-42fe-bb40-a8ba5fd950e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:27.600087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476b7dd-b415-42fe-bb40-a8ba5fd950e1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:27.610025 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 50/97] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:27 2022] GET /identity/v3/role_assignments?user.id=7541cbe0e8d54163bc5b518d916e8367&scope.project.id=34cf970684624d9299889d407e03239a&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:29.823753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0b377-604a-4942-a8f9-b2716f80f344 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:29.824295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0b377-604a-4942-a8f9-b2716f80f344 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:29.824865 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0b377-604a-4942-a8f9-b2716f80f344 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:29.826401 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 48/98] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:29.831856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f46f2-61c2-4058-accc-6ae4860c2fc5 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:29.832313 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f46f2-61c2-4058-accc-6ae4860c2fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:29.832388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f46f2-61c2-4058-accc-6ae4860c2fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:29.862343 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bd5f46f2-61c2-4058-accc-6ae4860c2fc5 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:29.863707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bd5f46f2-61c2-4058-accc-6ae4860c2fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:29.883258 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:29.954393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 51/99] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:30.214944 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8a686-2dd4-4b75-abac-3ee57964a3e0 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.215322 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8a686-2dd4-4b75-abac-3ee57964a3e0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.215593 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8a686-2dd4-4b75-abac-3ee57964a3e0 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.216945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 49/100] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:30.222500 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970314-0338-4d20-bdc5-c0799e39ff8e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.222785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970314-0338-4d20-bdc5-c0799e39ff8e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.222990 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a939b-e019-48c2-a8e2-ccb999164fd3 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.223115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1970314-0338-4d20-bdc5-c0799e39ff8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.223593 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a939b-e019-48c2-a8e2-ccb999164fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.224074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a939b-e019-48c2-a8e2-ccb999164fd3 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.225599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 50/101] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:30.231929 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1847-cff2-4d1d-809c-835f4cece050 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.232582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1847-cff2-4d1d-809c-835f4cece050 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.233049 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a1847-cff2-4d1d-809c-835f4cece050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.252508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:30.254342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b1970314-0338-4d20-bdc5-c0799e39ff8e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.255542 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b1970314-0338-4d20-bdc5-c0799e39ff8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.263446 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b88a1847-cff2-4d1d-809c-835f4cece050 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.265850 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b88a1847-cff2-4d1d-809c-835f4cece050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.370660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 52/102] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:30.419810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb139-b152-4805-98b1-dfc9afc71c9f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.420442 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb139-b152-4805-98b1-dfc9afc71c9f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.420909 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abb139-b152-4805-98b1-dfc9afc71c9f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.421927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 51/103] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:30.423044 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 53/104] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:30.428632 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64398-6f47-4c3a-ae43-8adcaf7c64a5 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.428915 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64398-6f47-4c3a-ae43-8adcaf7c64a5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.429265 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b64398-6f47-4c3a-ae43-8adcaf7c64a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.449475 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7aeb8-51ac-4b92-9b5f-df892e4d1034 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.450335 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7aeb8-51ac-4b92-9b5f-df892e4d1034 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.450862 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7aeb8-51ac-4b92-9b5f-df892e4d1034 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.452779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 54/105] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:30.457986 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c0b64398-6f47-4c3a-ae43-8adcaf7c64a5 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.458797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94d799-b8c0-4850-b3cf-e2de1d9568db None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.459261 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c0b64398-6f47-4c3a-ae43-8adcaf7c64a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.459514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94d799-b8c0-4850-b3cf-e2de1d9568db None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.459970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94d799-b8c0-4850-b3cf-e2de1d9568db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.498395 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-3b94d799-b8c0-4850-b3cf-e2de1d9568db None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.499892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3b94d799-b8c0-4850-b3cf-e2de1d9568db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.534707 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 52/106] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:30.592033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64398-6f47-4c3a-ae43-8adcaf7c64a5 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:30.603525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 55/107] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:30.651160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084ce2-56fa-41f2-8201-f9c5b269f7fb None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.651444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084ce2-56fa-41f2-8201-f9c5b269f7fb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.651719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5084ce2-56fa-41f2-8201-f9c5b269f7fb None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.653417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 56/108] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:30.658421 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5961f-629c-4aef-b8ec-34c69e94af45 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.658893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5961f-629c-4aef-b8ec-34c69e94af45 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.659334 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5961f-629c-4aef-b8ec-34c69e94af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.690413 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:30.703803 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-dfe5961f-629c-4aef-b8ec-34c69e94af45 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:30.705048 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-dfe5961f-629c-4aef-b8ec-34c69e94af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:30.719315 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:30.765884 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b64398-6f47-4c3a-ae43-8adcaf7c64a5 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:30.850590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:30.851234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:30.851483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:30.851765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:30.858960 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:30.860370 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:30.865134 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 53/109] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:30.870527 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:30.876471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 57/110] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:30.924895 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5961f-629c-4aef-b8ec-34c69e94af45 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:30.998133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a19d6b-2e70-4c36-909b-c4031d9a7787 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.035033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.035543 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.035818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.036088 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.036721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.038275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.043374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.068621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 54/111] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:02:30 2022] POST /identity/v3/projects => generated 302 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:31.069741 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.111300 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5961f-629c-4aef-b8ec-34c69e94af45 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.152447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.153468 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.153929 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.154336 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.166998 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:31.172826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:31.173923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:31.174752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:31.176843 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 58/112] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:31.177964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.182972 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.203531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d04f4a-10cb-4fb4-8316-47b1177f14ce None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.250311 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.250962 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.251239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.251511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.264241 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:31.269610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:31.270637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:31.271502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 55/113] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:31.274092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.313125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed9be-e151-4ded-9bba-bf92d6fabd30 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.339180 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.352201 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.352930 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.353217 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.353523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.367796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:31.375318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:31.376193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:31.376946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 59/114] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:31.377601 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.400145 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17274f5-cb28-4d76-bfe4-6bdb4aad9fe0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.439275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.439903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.440182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.440451 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.445859 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.453187 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:31.458220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:31.459082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:31.459856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 56/115] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:31.460478 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.492499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a4f08-1418-4132-8daa-473feef04c8c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.540876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.541879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.542362 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.542896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.543787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:31.544311 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.545952 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.555111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 60/116] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.556217 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.584072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53807b87-d965-416f-a63f-f5b3e872bcd7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.592268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.622228 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.622840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.623123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.623398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.624260 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:31.624573 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.626130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.635171 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 57/117] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.635938 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.671331 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110b96-bdc0-4e25-b65b-186c0029c0aa None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.696786 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.706546 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.707177 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.707452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.707724 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.719552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:31.724640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:31.725544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 61/118] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:31.732210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.756237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122884e-b649-4ddb-a35d-016feadd2fa6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.794838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.795451 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.795733 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.796009 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.796677 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:31.796986 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.798391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.807178 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 58/119] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.807178 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.835824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eda76f-1155-49cd-91e2-1f1f8b90e82d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.841871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.878853 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.879517 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.879746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.880019 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.880683 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:31.880989 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.882413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.891497 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 62/120] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.895072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:31.924149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f8359-7b85-42a3-b31d-0fe29cdc2421 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:31.954110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:31.960936 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:31.961592 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:31.961881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:31.962156 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] PATH_INFO: `/v3/users/3a6faffef1254eafa180a1020d50a19a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:31.963279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] RBAC: Authorizing `identity:get_user(user_id=3a6faffef1254eafa180a1020d50a19a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:31.965349 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:31.966937 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 59/121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/users/3a6faffef1254eafa180a1020d50a19a => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:31.967698 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.017894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4150ccd-ef45-4fdf-b301-8e212187ea5a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.055240 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.055875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.056156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.056431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] PATH_INFO: `/v3/users/6970b5e8c3174ea38646ce8478944763` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.070644 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] RBAC: Authorizing `identity:get_user(user_id=6970b5e8c3174ea38646ce8478944763)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.072526 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.078736 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 63/122] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/users/6970b5e8c3174ea38646ce8478944763 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.078736 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.081155 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.085636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c305d92-a8d2-4d10-813d-63f2e5e5fee3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.124406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.124933 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.125331 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.125645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.126458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:32.126765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.128167 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.141372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 60/123] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.141372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.186089 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ddde64-3fe0-4ae4-9160-2ac9df069578 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.194910 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.227183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.227915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.228192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.228472 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.229645 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.231145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.232764 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 64/124] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.233572 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.256138 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492959a2-19e3-40e9-83e7-d479e8cbdddc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.294546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.295573 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.296148 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.296433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.297599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.299264 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.305535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 61/125] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.306583 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.341189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.345946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e3aad-d69a-4646-b7bc-2e2f8f66d213 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.380953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.381529 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.381807 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.382078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.383200 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.384656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.387269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 65/126] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.388049 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.422924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e19284-5f08-431b-be5a-51289a1b02fc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.432633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.458212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.458819 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.459099 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.459376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.492345 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960130f-041e-46d0-93e7-c0b48864514f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.529985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.530693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.530977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.531249 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.532183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.532434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.533679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.533900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.535476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 66/127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.536235 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.567966 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.647142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b18397-93ed-4198-b5c5-ac5e62ab0336 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.652665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 62/128] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:32.654300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.659266 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.685961 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.686979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.686979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.687487 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.688595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.690180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.698870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 67/129] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.698870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.786860 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48ddd-26bf-4219-b0e4-16fccabd76f8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.817090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d4a9c-77a1-4095-819b-c0589d94bb53 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:32.821426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:32.832456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.833696 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.834304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.834749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.836681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.839310 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.842558 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 63/130] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:32.848638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.862194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:32.862862 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:32.863138 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:32.863410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc/users/3a6faffef1254eafa180a1020d50a19a/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:32.865467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6523217f47c448f6abb285a0acc204dc, user_id=3a6faffef1254eafa180a1020d50a19a, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:32.867056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:32.881743 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 68/131] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:32 2022] PUT /identity/v3/projects/6523217f47c448f6abb285a0acc204dc/users/3a6faffef1254eafa180a1020d50a19a/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:32.883212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:32.953010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.013564 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3ab7e-bc42-46e7-81df-75337866964f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.059298 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eebf6-d1bb-49d8-be39-ce310001b1a6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.065362 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.066617 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.067221 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.067572 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] PATH_INFO: `/v3/projects/34cf970684624d9299889d407e03239a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.069480 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] RBAC: Authorizing `identity:get_project(project_id=34cf970684624d9299889d407e03239a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.071505 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.074366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 64/132] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/projects/34cf970684624d9299889d407e03239a => generated 312 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:33.075672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:33.111824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.112575 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.112959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.113305 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.114785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.116466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.118487 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 69/133] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:32 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:33.121364 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:33.154825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.203329 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b8aad9-c342-4be3-8734-afcde889b1f4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.250071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9dad99-db09-42e1-b1c4-bcebbf053051 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.258260 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.259106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.259979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.260308 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.260688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc/users/7541cbe0e8d54163bc5b518d916e8367/roles/c30a3e1df1b74cd186fed662062d8e9d` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.263559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] RBAC: Authorizing `identity:create_grant(project_id=6523217f47c448f6abb285a0acc204dc, user_id=7541cbe0e8d54163bc5b518d916e8367, role_id=c30a3e1df1b74cd186fed662062d8e9d)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.266471 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.297421 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 65/134] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:33 2022] PUT /identity/v3/projects/6523217f47c448f6abb285a0acc204dc/users/7541cbe0e8d54163bc5b518d916e8367/roles/c30a3e1df1b74cd186fed662062d8e9d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:33.298278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:33.303958 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.305306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.306015 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.306611 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc/users/7541cbe0e8d54163bc5b518d916e8367/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.311725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] RBAC: Authorizing `identity:create_grant(project_id=6523217f47c448f6abb285a0acc204dc, user_id=7541cbe0e8d54163bc5b518d916e8367, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.314254 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.338316 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 70/135] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:33 2022] PUT /identity/v3/projects/6523217f47c448f6abb285a0acc204dc/users/7541cbe0e8d54163bc5b518d916e8367/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:33.340505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:33.497028 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653a68f-5687-4014-b71e-4723b0541afd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.515796 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70775b45-5c7f-4dd0-8253-d9f76dbb7d70 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:33.547675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0fa99-2d48-474b-9fea-ae9b6b509887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.548491 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0fa99-2d48-474b-9fea-ae9b6b509887 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.548868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0fa99-2d48-474b-9fea-ae9b6b509887 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.549238 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0fa99-2d48-474b-9fea-ae9b6b509887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.550322 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0fa99-2d48-474b-9fea-ae9b6b509887 None admin] RBAC: Adding query filter params (role.id=5c86b05b98c743b68180b4256769d70a, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=6970b5e8c3174ea38646ce8478944763) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:33.550737 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0fa99-2d48-474b-9fea-ae9b6b509887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.552354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0fa99-2d48-474b-9fea-ae9b6b509887 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.561384 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 71/136] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:33 2022] GET /identity/v3/role_assignments?user.id=6970b5e8c3174ea38646ce8478944763&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=5c86b05b98c743b68180b4256769d70a => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:33.594691 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.629355 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064113a-17bc-4622-a40d-f71e50c90e9b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.629725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064113a-17bc-4622-a40d-f71e50c90e9b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.629909 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064113a-17bc-4622-a40d-f71e50c90e9b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.633118 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 72/137] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:33.634213 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:33.634917 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.635192 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.635462 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] PATH_INFO: `/v3/projects/34cf970684624d9299889d407e03239a/users/7541cbe0e8d54163bc5b518d916e8367/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.638683 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6da6-9179-4430-9914-fe28813e8912 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:33.639098 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6da6-9179-4430-9914-fe28813e8912 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:33.639346 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f6da6-9179-4430-9914-fe28813e8912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:33.639779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] RBAC: Authorizing `identity:create_grant(project_id=34cf970684624d9299889d407e03239a, user_id=7541cbe0e8d54163bc5b518d916e8367, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:33.641679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:33.669839 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-228f6da6-9179-4430-9914-fe28813e8912 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:33.674396 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-228f6da6-9179-4430-9914-fe28813e8912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:33.676710 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 66/138] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:33 2022] PUT /identity/v3/projects/34cf970684624d9299889d407e03239a/users/7541cbe0e8d54163bc5b518d916e8367/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:33.715824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:33.780277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 73/139] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:34.240083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.366708 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22474f2-3da6-4006-a4f1-3efa60530354 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.419302 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7c5f4-c698-4ae6-9ee4-7ddf3fb3b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.419942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c5f4-c698-4ae6-9ee4-7ddf3fb3b26d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.420230 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c5f4-c698-4ae6-9ee4-7ddf3fb3b26d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.420496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7c5f4-c698-4ae6-9ee4-7ddf3fb3b26d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.425640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c5f4-c698-4ae6-9ee4-7ddf3fb3b26d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:34.427217 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7c5f4-c698-4ae6-9ee4-7ddf3fb3b26d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:34.428951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 67/140] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:34.434934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6da6-9179-4430-9914-fe28813e8912 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:34.570566 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f6da6-9179-4430-9914-fe28813e8912 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:34.616999 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e2ba-e2a1-4079-b430-db112275e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:34.617632 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e2ba-e2a1-4079-b430-db112275e40b None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:34.617911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e2ba-e2a1-4079-b430-db112275e40b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:34.626215 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e2ba-e2a1-4079-b430-db112275e40b None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:34.626894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e2ba-e2a1-4079-b430-db112275e40b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:34.628354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e2ba-e2a1-4079-b430-db112275e40b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:34.653548 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 74/141] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:34 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:35.823200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a0ac-001c-41f7-ab3c-e2ad7778a03e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:35.824504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a0ac-001c-41f7-ab3c-e2ad7778a03e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:35.824504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910a0ac-001c-41f7-ab3c-e2ad7778a03e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:35.825978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 68/142] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:35.832571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a481-fcd2-4408-bb99-a5af725c6646 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:35.833236 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a481-fcd2-4408-bb99-a5af725c6646 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:35.833236 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a481-fcd2-4408-bb99-a5af725c6646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:35.860807 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d754a481-fcd2-4408-bb99-a5af725c6646 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:35.862045 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d754a481-fcd2-4408-bb99-a5af725c6646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:35.875239 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:35.944888 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 75/143] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:36.609008 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fafb0a-2d75-46d1-bb7a-8ff6f76b4d6b None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.609441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fafb0a-2d75-46d1-bb7a-8ff6f76b4d6b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.609608 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fafb0a-2d75-46d1-bb7a-8ff6f76b4d6b None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.611195 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 69/144] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:36.618147 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6cfd3-583d-4aa1-ab6e-d1adc74540bd None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.618454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6cfd3-583d-4aa1-ab6e-d1adc74540bd None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.618680 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b6cfd3-583d-4aa1-ab6e-d1adc74540bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.622875 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fafb0a-2d75-46d1-bb7a-8ff6f76b4d6b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:36.664163 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-69b6cfd3-583d-4aa1-ab6e-d1adc74540bd None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:36.666908 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-69b6cfd3-583d-4aa1-ab6e-d1adc74540bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:36.729697 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:36.787540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 76/145] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:36.788832 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75f5d-6455-4515-ab2f-02c698038721 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.789113 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75f5d-6455-4515-ab2f-02c698038721 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.789419 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75f5d-6455-4515-ab2f-02c698038721 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.790796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 77/146] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:36.796575 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c598939-3bd0-4d91-bb65-707932bc3de8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.796854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c598939-3bd0-4d91-bb65-707932bc3de8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.797128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c598939-3bd0-4d91-bb65-707932bc3de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.825349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-3c598939-3bd0-4d91-bb65-707932bc3de8 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:36.825349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3c598939-3bd0-4d91-bb65-707932bc3de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:36.831900 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fafb0a-2d75-46d1-bb7a-8ff6f76b4d6b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:36.887360 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:36.888336 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:36.888830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:36.889312 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:36.907082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:36.909047 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 78/147] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:36.912295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:36.913162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:36.913989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:36.917564 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 70/148] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:36.926461 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c598939-3bd0-4d91-bb65-707932bc3de8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:36.977771 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.078945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c598939-3bd0-4d91-bb65-707932bc3de8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.123513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19995178-81ea-4c41-9be3-1561e0b50f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.124532 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995178-81ea-4c41-9be3-1561e0b50f90 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.125014 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995178-81ea-4c41-9be3-1561e0b50f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.125509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19995178-81ea-4c41-9be3-1561e0b50f90 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.126371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995178-81ea-4c41-9be3-1561e0b50f90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:37.126877 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995178-81ea-4c41-9be3-1561e0b50f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:37.128543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19995178-81ea-4c41-9be3-1561e0b50f90 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:37.138646 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 79/149] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:37.146406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.282873 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c366-13fe-4f4b-95c0-d8f1e2883b34 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.283526 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c366-13fe-4f4b-95c0-d8f1e2883b34 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.284016 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252c366-13fe-4f4b-95c0-d8f1e2883b34 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.289486 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83940d6-19e0-4525-80fa-99d44bbfa05a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.290157 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 80/150] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:37.296002 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835bc71-ef49-47c1-8fae-43fba9d753f4 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.296548 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835bc71-ef49-47c1-8fae-43fba9d753f4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.297035 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835bc71-ef49-47c1-8fae-43fba9d753f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.312162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.334327 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4835bc71-ef49-47c1-8fae-43fba9d753f4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:37.335529 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4835bc71-ef49-47c1-8fae-43fba9d753f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:37.347443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.348083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.348362 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.348638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] PATH_INFO: `/v3/users/3a6faffef1254eafa180a1020d50a19a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.354002 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] RBAC: Authorizing `identity:get_user(user_id=3a6faffef1254eafa180a1020d50a19a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:37.355733 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:37.357696 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 71/151] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/users/3a6faffef1254eafa180a1020d50a19a => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:37.363397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.437826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.451090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 81/152] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:37.452415 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835bc71-ef49-47c1-8fae-43fba9d753f4 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.495495 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f58b0f-43e0-40fa-9f83-1813795c2d1d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.551818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.552433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.552755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.553032 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.587246 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835bc71-ef49-47c1-8fae-43fba9d753f4 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:37.629667 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.655110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:37.655806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:37.656080 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:37.656340 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:37.666240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:37.668387 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:37.685934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:37.696140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:37.697010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:37.698443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 82/153] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:37.703641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.836866 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:37.871585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 72/154] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:37.872695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:37.949860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb99f3f-1c30-4395-921f-9a77c5e7e076 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.006273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.031510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb815af-39b1-47a4-8fd4-3535969db698 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.064399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.065385 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.065889 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.066350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.067224 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:38.067716 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.076521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.089073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 83/155] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.094091 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3bff8-0e28-41ab-a09a-803bfe416cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.094254 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.094743 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3bff8-0e28-41ab-a09a-803bfe416cdc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.095052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3bff8-0e28-41ab-a09a-803bfe416cdc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.095291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3bff8-0e28-41ab-a09a-803bfe416cdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.119032 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3bff8-0e28-41ab-a09a-803bfe416cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-06d3bff8-0e28-41ab-a09a-803bfe416cdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:38.124881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:38.125823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:38.126749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 73/156] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:38.127498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fcd0-8af4-4086-992e-342240bd9b9a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.127563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fcd0-8af4-4086-992e-342240bd9b9a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.128520 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967fcd0-8af4-4086-992e-342240bd9b9a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.129413 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 74/157] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:38.130166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967fcd0-8af4-4086-992e-342240bd9b9a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.245415 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967fcd0-8af4-4086-992e-342240bd9b9a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.292355 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.293823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.294227 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.294517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.295649 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.297087 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.298683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 75/158] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.299443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.319285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.320515 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afe0ba-fbf0-4ce3-a4e5-d100809de3e4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.373997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.426285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c0d9a4-0eac-49a1-b545-809f39b3b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.427429 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0d9a4-0eac-49a1-b545-809f39b3b693 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.427429 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0d9a4-0eac-49a1-b545-809f39b3b693 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.427618 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c0d9a4-0eac-49a1-b545-809f39b3b693 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.434271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0d9a4-0eac-49a1-b545-809f39b3b693 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.435740 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c0d9a4-0eac-49a1-b545-809f39b3b693 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.442192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 84/159] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.443295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a055684-7707-48ba-a2dc-ed1281afddd3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.443575 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a055684-7707-48ba-a2dc-ed1281afddd3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.443848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a055684-7707-48ba-a2dc-ed1281afddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.451034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a288fc-cd57-4161-bb7a-f50132cc0717 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.489664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.490452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.490730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.490998 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.498392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5a055684-7707-48ba-a2dc-ed1281afddd3 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:38.499545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5a055684-7707-48ba-a2dc-ed1281afddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:38.502286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:38.507711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:38.510581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 76/160] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:38.511999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.594267 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.629794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cc04f-6854-48a2-978c-f407e95a75b5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.662997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 85/161] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:38.663853 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a055684-7707-48ba-a2dc-ed1281afddd3 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.711197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.711862 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.712139 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.712411 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:38.713071 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:38.713576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:38.715149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:38.736767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 77/162] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:38.737525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:38.864198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a055684-7707-48ba-a2dc-ed1281afddd3 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:38.921818 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:38.962064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:38.962678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:38.962962 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:38.963229 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.010438 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f4af8-3630-4c01-9641-2891a7763625 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.054778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.067235 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.068457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.068756 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.069032 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.069816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=3a6faffef1254eafa180a1020d50a19a) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:39.070166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.075423 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.087837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 78/163] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/role_assignments?user.id=3a6faffef1254eafa180a1020d50a19a&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 608 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.088893 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.149531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.151188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.263857 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafe55b-5d78-46b4-80f3-b29e5cd38512 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.321931 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 86/164] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:39.322915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.349757 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.363580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.364578 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.365120 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.365627 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.366491 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:39.366986 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.368587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.389079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 79/165] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.390443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.481989 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1edfbd-888e-4679-add3-72642b318781 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.506389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.528822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.529512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.529790 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.530063 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.533738 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.535199 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.536793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 87/166] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.537575 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.638820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad401491-74a5-424c-a44f-269a3d632c18 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.661707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.698239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.699434 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.699858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.700133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.701354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.701521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee04e7a-416d-4d51-aaab-dc9f1d49aed8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.702815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.704825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 80/167] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.705673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.755995 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.756550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.756824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.757093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.769798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:39.775050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:39.775915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:39.777179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 88/168] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:39.781633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.887843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a212032-b684-4c1d-88ec-231d69dd8ef4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.919958 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:39.923753 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdc528b-701e-41d7-bf20-d5e5c462c80b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:39.931142 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.931891 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.932237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.932581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] PATH_INFO: `/v3/users/6970b5e8c3174ea38646ce8478944763` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.934752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] RBAC: Authorizing `identity:get_user(user_id=6970b5e8c3174ea38646ce8478944763)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:39.936367 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:39.938343 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 81/169] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/users/6970b5e8c3174ea38646ce8478944763 => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:39.939364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:39.966397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edfc5a-d684-4377-9d63-a2acf125091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:39.967001 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfc5a-d684-4377-9d63-a2acf125091a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:39.967333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfc5a-d684-4377-9d63-a2acf125091a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:39.967598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edfc5a-d684-4377-9d63-a2acf125091a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:39.987171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.044950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edfc5a-d684-4377-9d63-a2acf125091a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.046845 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98edfc5a-d684-4377-9d63-a2acf125091a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.065117 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389b45-ceb2-4ccb-ae56-4f7f502e56b7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.098457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.099055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.099329 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.099593 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.100307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] RBAC: Adding query filter params (role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=7541cbe0e8d54163bc5b518d916e8367) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:40.100606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.102062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.109275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 82/170] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/role_assignments?user.id=7541cbe0e8d54163bc5b518d916e8367&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.110076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.158427 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 89/171] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:40.160145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5e81-0a7b-4237-a3d0-81161d38f066 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.160626 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5e81-0a7b-4237-a3d0-81161d38f066 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.161092 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5e81-0a7b-4237-a3d0-81161d38f066 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.162673 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 90/172] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:40.163615 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5e81-0a7b-4237-a3d0-81161d38f066 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.185504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.218004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.240353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dd1be-2a24-4178-91a1-fe3c27687e11 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.280349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5e81-0a7b-4237-a3d0-81161d38f066 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.281311 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4146e27-1dff-4da8-a339-34b8f7d4ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.281980 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146e27-1dff-4da8-a339-34b8f7d4ba84 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.282256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146e27-1dff-4da8-a339-34b8f7d4ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.282524 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4146e27-1dff-4da8-a339-34b8f7d4ba84 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.283182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4146e27-1dff-4da8-a339-34b8f7d4ba84 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:40.283475 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4146e27-1dff-4da8-a339-34b8f7d4ba84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.284875 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4146e27-1dff-4da8-a339-34b8f7d4ba84 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.298502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 83/173] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.298502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca81e-4a3d-49c4-ab79-02323d1aeb8f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.298502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca81e-4a3d-49c4-ab79-02323d1aeb8f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.298502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ca81e-4a3d-49c4-ab79-02323d1aeb8f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.299891 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 84/174] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:40.300365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75ade-f4b1-4ceb-9a28-88e938da2e06 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.300512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75ade-f4b1-4ceb-9a28-88e938da2e06 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.300813 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec75ade-f4b1-4ceb-9a28-88e938da2e06 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.302248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 85/175] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:40.306349 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75ade-f4b1-4ceb-9a28-88e938da2e06 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.333661 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7846a27e-9276-4e7d-b297-e17028e2cbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.334292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a27e-9276-4e7d-b297-e17028e2cbed None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.334566 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a27e-9276-4e7d-b297-e17028e2cbed None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.334847 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7846a27e-9276-4e7d-b297-e17028e2cbed None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.337699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846a27e-9276-4e7d-b297-e17028e2cbed None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.338393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7846a27e-9276-4e7d-b297-e17028e2cbed None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.340306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 91/176] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.341677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b16c02-326e-4f1e-8276-c5b73642fd74 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.341954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b16c02-326e-4f1e-8276-c5b73642fd74 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.342222 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b16c02-326e-4f1e-8276-c5b73642fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.360511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-44b16c02-326e-4f1e-8276-c5b73642fd74 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:40.361749 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-44b16c02-326e-4f1e-8276-c5b73642fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:40.422299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec75ade-f4b1-4ceb-9a28-88e938da2e06 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.434852 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 92/177] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:40.437504 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b16c02-326e-4f1e-8276-c5b73642fd74 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.443524 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.462848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45725a8f-a6ca-4bd2-9ca7-a8b89ba9ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.463601 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45725a8f-a6ca-4bd2-9ca7-a8b89ba9ec27 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.463974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45725a8f-a6ca-4bd2-9ca7-a8b89ba9ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.464248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45725a8f-a6ca-4bd2-9ca7-a8b89ba9ec27 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.466046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45725a8f-a6ca-4bd2-9ca7-a8b89ba9ec27 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.467682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45725a8f-a6ca-4bd2-9ca7-a8b89ba9ec27 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.469284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 86/178] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.470394 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a81d8-d5a1-4914-8402-07887eecec73 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.470673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a81d8-d5a1-4914-8402-07887eecec73 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.470938 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a81d8-d5a1-4914-8402-07887eecec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.486769 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.489072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-cd5a81d8-d5a1-4914-8402-07887eecec73 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:40.490254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-cd5a81d8-d5a1-4914-8402-07887eecec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:40.545198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b16c02-326e-4f1e-8276-c5b73642fd74 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.564795 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 87/179] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:40.566094 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2fdbd-5592-44b6-9c94-e77c66fb83d2 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.566375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2fdbd-5592-44b6-9c94-e77c66fb83d2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.566642 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2fdbd-5592-44b6-9c94-e77c66fb83d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.591522 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.593001 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.593974 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.594511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] PATH_INFO: `/v3/users/7541cbe0e8d54163bc5b518d916e8367` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.595943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] RBAC: Authorizing `identity:get_user(user_id=7541cbe0e8d54163bc5b518d916e8367)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.597240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-8be2fdbd-5592-44b6-9c94-e77c66fb83d2 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:40.598077 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.598426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-8be2fdbd-5592-44b6-9c94-e77c66fb83d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:40.600384 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 93/180] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/users/7541cbe0e8d54163bc5b518d916e8367 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.602324 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.670571 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 88/181] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:40.678309 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2fdbd-5592-44b6-9c94-e77c66fb83d2 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.725569 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de51e40-a056-49bb-a9e1-7b7de560315e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.739763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.764814 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.765031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.765307 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.765599 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc/users/6970b5e8c3174ea38646ce8478944763/roles/5c86b05b98c743b68180b4256769d70a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.767569 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] RBAC: Authorizing `identity:create_grant(project_id=6523217f47c448f6abb285a0acc204dc, user_id=6970b5e8c3174ea38646ce8478944763, role_id=5c86b05b98c743b68180b4256769d70a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.769025 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.783356 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 94/182] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:40 2022] PUT /identity/v3/projects/6523217f47c448f6abb285a0acc204dc/users/6970b5e8c3174ea38646ce8478944763/roles/5c86b05b98c743b68180b4256769d70a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:40.784101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:40.784932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.855688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2fdbd-5592-44b6-9c94-e77c66fb83d2 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:40.898783 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:40.900232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:40.900709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:40.901199 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:40.902510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=7541cbe0e8d54163bc5b518d916e8367) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:40.903219 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:40.905037 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:40.912386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 89/183] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/role_assignments?user.id=7541cbe0e8d54163bc5b518d916e8367&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:40.913756 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:40.952206 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836f566-06bb-4fe0-81cd-f376d214c56a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.033896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.034695 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.034900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.035169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.086255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.108370 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519b691-5ef0-42ce-a171-ad8a1d556526 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.121647 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.122690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.124589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.154319 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.155065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.155333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.155759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.171382 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:41.176599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:41.177494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:41.178292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 90/184] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:41.179647 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.244849 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 95/185] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:41.245793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.317626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a64aa4-40ab-4837-a3a6-d66c9ff7650a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.332681 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.355341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.356007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.356252 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.356523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.357674 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.359166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.360672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 91/186] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.361466 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.371676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d907e-ffe7-4ed2-b4bb-bd71f9b10c15 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.405917 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.413302 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.413965 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.414242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.414515 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.424987 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:41.429796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:41.430669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 96/187] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:41.434159 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.476324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3dd44c-f6c4-40ab-abe3-387bba716463 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.515849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.516460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.516740 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.517004 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.517710 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:41.518393 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.519801 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.529893 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 92/188] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.535072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.545136 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf2b8f-fb16-4b58-be35-c9d12599df0a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.575549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.580823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.582247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.582559 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.582834 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] PATH_INFO: `/v3/projects/34cf970684624d9299889d407e03239a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.583956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] RBAC: Authorizing `identity:get_project(project_id=34cf970684624d9299889d407e03239a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.585418 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.587199 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 97/189] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/projects/34cf970684624d9299889d407e03239a => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.593115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.649085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.653013 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7d05f-96b8-4f8b-a74a-46b36a4d1664 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.690923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.691529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.691805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.692074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.692705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.694168 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.709613 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4325e1-a5e2-4fa7-b989-420871fdf91c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.721373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 93/190] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:41 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:41.721373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.751779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.752941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.753517 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.753796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.754482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:41.755071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.756902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.770833 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 98/191] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.771816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.854412 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:41.879832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c002ef91-444b-4092-a506-ae760bf44c20 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.906553 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26c92a-0e5a-46fa-99db-ad772e7c1150 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:41.922160 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.922799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.923155 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.923428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] PATH_INFO: `/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.944817 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb837ddd7884ca79e1cdf0138f3ad9d)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.946307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.947563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:41.947989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 94/192] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.948562 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:41.949301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.949679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:41.950088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:41.951037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=34cf970684624d9299889d407e03239a, user.id=7541cbe0e8d54163bc5b518d916e8367) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:41.951501 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:41.953096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:41.961451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 99/193] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/role_assignments?user.id=7541cbe0e8d54163bc5b518d916e8367&scope.project.id=34cf970684624d9299889d407e03239a&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:41.962492 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:41.973969 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.110078 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb83e3-a22a-46dd-aac1-3fc923990436 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.141996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f376-801a-42b8-b311-f9173195a0fa None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.168713 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.171766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.171766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.171766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] PATH_INFO: `/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.172688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] RBAC: Authorizing `identity:get_user(user_id=bdb837ddd7884ca79e1cdf0138f3ad9d)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.175021 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.176508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 95/194] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:42.180109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.186115 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.192761 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.193406 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.193756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.194033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.279906 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.281506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.291366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.323075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65614a-ab0c-4fce-b0f7-5f4ba202029c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.370990 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.371203 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.371671 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.373223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.425250 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 100/195] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:42.431868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.465766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.467861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.470235 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.564742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fca43-7469-4194-b2c1-f140541a1171 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.602577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.603539 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.604004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.604450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.606598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.608349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.610646 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 101/196] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:42.616606 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.630925 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.659884 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 96/197] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:42.665943 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:42.766665 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:42.776993 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d89aac0-f452-4edf-8e71-8ae5bfa8c8cd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.828481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.829089 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.829404 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.829659 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.831518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=bdb837ddd7884ca79e1cdf0138f3ad9d) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:42.831848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.833333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.849658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 102/198] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/role_assignments?user.id=bdb837ddd7884ca79e1cdf0138f3ad9d&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:42.864280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6720c54d-c115-4aa7-ac4a-8cde3b282906 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:42.904200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb584f19-dddd-4188-99bd-9e4d1419fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:42.904832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584f19-dddd-4188-99bd-9e4d1419fd66 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:42.905116 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584f19-dddd-4188-99bd-9e4d1419fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:42.905420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb584f19-dddd-4188-99bd-9e4d1419fd66 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:42.906569 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb584f19-dddd-4188-99bd-9e4d1419fd66 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:42.908233 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb584f19-dddd-4188-99bd-9e4d1419fd66 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:42.910169 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 97/199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:42.916147 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:43.064193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a3651-1be1-4bbc-a03a-ae4ca1e89f4d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:43.115353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e189823-5abf-4476-ba8e-976fca772284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:43.115962 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189823-5abf-4476-ba8e-976fca772284 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.116240 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189823-5abf-4476-ba8e-976fca772284 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.116509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e189823-5abf-4476-ba8e-976fca772284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.117233 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e189823-5abf-4476-ba8e-976fca772284 None admin] RBAC: Adding query filter params (role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=bdb837ddd7884ca79e1cdf0138f3ad9d) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:43.117638 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e189823-5abf-4476-ba8e-976fca772284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:43.119090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e189823-5abf-4476-ba8e-976fca772284 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:43.129765 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 103/200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:42 2022] GET /identity/v3/role_assignments?user.id=bdb837ddd7884ca79e1cdf0138f3ad9d&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:43.458092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af5a2b-8818-438b-b098-b4aed6b9d200 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.458953 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af5a2b-8818-438b-b098-b4aed6b9d200 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.459370 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af5a2b-8818-438b-b098-b4aed6b9d200 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.460940 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 98/201] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:43.466589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9234b-2555-441e-b075-f6226f8f460b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:43.467074 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9234b-2555-441e-b075-f6226f8f460b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:43.467175 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9234b-2555-441e-b075-f6226f8f460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:43.494689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-fbb9234b-2555-441e-b075-f6226f8f460b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:43.495997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-fbb9234b-2555-441e-b075-f6226f8f460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:43.519325 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:43.593259 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 104/202] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:44.091023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af5a2b-8818-438b-b098-b4aed6b9d200 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.155321 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:44.230494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af5a2b-8818-438b-b098-b4aed6b9d200 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.279240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.279796 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.280075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.280345 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.298124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:44.302882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:44.303779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:44.305200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 99/203] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:44.310233 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9234b-2555-441e-b075-f6226f8f460b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.430444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9234b-2555-441e-b075-f6226f8f460b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.479933 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.480582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.480907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.481068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.481781 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:44.482086 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:44.483465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:44.497204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 105/204] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:44.502472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.660184 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c12a6d-c7f7-498b-a0a1-0e3498301671 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.676507 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:44.716007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d398b8a-1c33-439a-a30f-252343c85331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.716641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398b8a-1c33-439a-a30f-252343c85331 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.716912 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398b8a-1c33-439a-a30f-252343c85331 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.717173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398b8a-1c33-439a-a30f-252343c85331 None admin] PATH_INFO: `/v3/users/6970b5e8c3174ea38646ce8478944763` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.718340 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398b8a-1c33-439a-a30f-252343c85331 None admin] RBAC: Authorizing `identity:get_user(user_id=6970b5e8c3174ea38646ce8478944763)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:44.719768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398b8a-1c33-439a-a30f-252343c85331 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:44.721347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 100/205] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/users/6970b5e8c3174ea38646ce8478944763 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:44.726875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:44.758478 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:44.808659 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cdff0-a5c7-4295-92a0-ad0de2295b38 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.809058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cdff0-a5c7-4295-92a0-ad0de2295b38 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.809229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cdff0-a5c7-4295-92a0-ad0de2295b38 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.810566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 101/206] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:44.815789 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63887e2-3d69-415d-841f-95d58e4fa7ab None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.816064 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63887e2-3d69-415d-841f-95d58e4fa7ab None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.816353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63887e2-3d69-415d-841f-95d58e4fa7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:44.835870 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a63887e2-3d69-415d-841f-95d58e4fa7ab None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:44.837650 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a63887e2-3d69-415d-841f-95d58e4fa7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:44.917467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be5ce4-845e-4672-b0df-d1b3af2526f6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:44.922979 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 102/207] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:44.969181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:44.969817 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:44.970092 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:44.970358 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.046083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.046674 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e43e0a-4273-4fa3-9883-2c96e871a558 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.047328 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e43e0a-4273-4fa3-9883-2c96e871a558 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.047529 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.047993 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e43e0a-4273-4fa3-9883-2c96e871a558 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.049562 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 103/208] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:45.058826 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722a18-0a0f-4352-a8a2-49248bcabe0b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.059480 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722a18-0a0f-4352-a8a2-49248bcabe0b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.059977 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c722a18-0a0f-4352-a8a2-49248bcabe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.063338 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.098818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-8c722a18-0a0f-4352-a8a2-49248bcabe0b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:45.099998 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-8c722a18-0a0f-4352-a8a2-49248bcabe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:45.154353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 106/209] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:45.160267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.220353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 104/210] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:45.302397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf85ad-3e2b-4da7-a7b8-890019ae1860 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.317842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.344802 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.345506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.345783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.346051 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.350006 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.351470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.353263 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 107/211] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.358962 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722a18-0a0f-4352-a8a2-49248bcabe0b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.412005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.450166 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.494516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c722a18-0a0f-4352-a8a2-49248bcabe0b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.532747 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.534201 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.534678 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.535164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.536083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] RBAC: Adding query filter params (role.id=5c86b05b98c743b68180b4256769d70a, scope.project.id=6523217f47c448f6abb285a0acc204dc, user.id=6970b5e8c3174ea38646ce8478944763) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:45.536590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.538263 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.544993 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 105/212] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/role_assignments?user.id=6970b5e8c3174ea38646ce8478944763&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=5c86b05b98c743b68180b4256769d70a => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.617119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.632508 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2511353-135f-49a2-bb11-4ba6b211a137 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.721040 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.721734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.722008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.722272 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.724459 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.725997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.733523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 108/213] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:45.742947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.776380 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2368a-d30c-4c36-9e7b-6f321564827b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.778067 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.809726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:45.829363 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b4f264-743d-4b7e-957d-00bcc9079f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.830028 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4f264-743d-4b7e-957d-00bcc9079f0e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.830296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4f264-743d-4b7e-957d-00bcc9079f0e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.830568 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b4f264-743d-4b7e-957d-00bcc9079f0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.844022 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b4f264-743d-4b7e-957d-00bcc9079f0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-29b4f264-743d-4b7e-957d-00bcc9079f0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:45.850076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:45.850965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:45.851763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 106/214] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:45.852960 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5271b1-d91d-488c-a80a-247e4ae90c65 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.853615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5271b1-d91d-488c-a80a-247e4ae90c65 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.853783 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5271b1-d91d-488c-a80a-247e4ae90c65 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.855898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 107/215] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:45.865244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734590cf-c005-406b-8616-1b825ae87cbf None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.865566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734590cf-c005-406b-8616-1b825ae87cbf None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.865838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734590cf-c005-406b-8616-1b825ae87cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.884803 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41287d0b-b1ad-4914-b5e5-e28fe031256f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:45.885036 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-734590cf-c005-406b-8616-1b825ae87cbf None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:45.886397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-734590cf-c005-406b-8616-1b825ae87cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:45.934356 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:45.935421 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:45.935870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:45.936347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:45.937062 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:45.938678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:45.962540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 109/216] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:45 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:45.963228 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:45.996419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 108/217] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:46.081304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e7c1-9687-4398-8223-fbf8f13ddb1a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.081937 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e7c1-9687-4398-8223-fbf8f13ddb1a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.082430 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1e7c1-9687-4398-8223-fbf8f13ddb1a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.084041 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 109/218] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:46.087351 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c48218-64e5-44a2-942b-08ecdcfe70c9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.091051 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899c440-0d09-43c7-859f-b47cb4aa4577 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.091612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899c440-0d09-43c7-859f-b47cb4aa4577 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.092087 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899c440-0d09-43c7-859f-b47cb4aa4577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.096142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.116396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3899c440-0d09-43c7-859f-b47cb4aa4577 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:46.118212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3899c440-0d09-43c7-859f-b47cb4aa4577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:46.130557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.131292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.131577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.131848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.132525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:46.132901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.134581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.144494 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 110/219] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:46.150418 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.206579 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 110/220] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:46.266252 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846463c3-ff86-4306-bdc6-f124627b7e80 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.313293 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.314292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.314845 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.315313 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] PATH_INFO: `/v3/users/8cefa19cfb5d43d3b1747b9677fc534e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.328222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899c440-0d09-43c7-859f-b47cb4aa4577 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.333177 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] RBAC: Authorizing `identity:get_user(user_id=8cefa19cfb5d43d3b1747b9677fc534e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.334908 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.336606 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 111/221] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/users/8cefa19cfb5d43d3b1747b9677fc534e => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:46.343569 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.359303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.384228 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.474677 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899c440-0d09-43c7-859f-b47cb4aa4577 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.485670 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f608e-9424-4fee-9392-37d576a768a5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.518500 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.519176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.519450 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.519721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.536538 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.537012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.537284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.537580 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.537844 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:46.543124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:46.543992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:46.544776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 111/222] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:46.555363 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.626808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.629165 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.658341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.670346 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.682442 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ea5b3-3b63-4e39-b7a4-5fcd0ebd6a8e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.727840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.728689 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.729137 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.729579 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.731301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:46.731775 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.733830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.745068 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 112/223] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:46.746834 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.762413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 112/224] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:46.763460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.885123 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f02bb-9403-41ea-abd2-8e363051c32c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.891061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dd72a-4384-4374-823a-903d9e1dddb0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:46.929348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:46.931011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.931914 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.932449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.932828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.935604 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:46.937010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:46.937465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:46.937878 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] PATH_INFO: `/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:46.939216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb837ddd7884ca79e1cdf0138f3ad9d)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:46.941116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:46.943558 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 113/225] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:46.944464 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.946202 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:46.951987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:46.953101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:46.954129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:46.955752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 113/226] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:46.956618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:46.961396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.074227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128738-b1db-4764-898a-3ea202861c43 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.108164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d55bb-6e5a-4a7a-8cd7-92aa0e55dd42 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.111400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.111531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.111784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.112059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.113176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.114659 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.116352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 114/227] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.121360 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.163284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.164879 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.165234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.165600 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.166921 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.169143 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.171038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 114/228] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:46 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.171689 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.205307 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.253654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.259013 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3993c-d7b8-4ae2-bf01-1def493c75fb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.288752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee31cc-5846-4c9b-bb29-90a8ee771e0f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.303500 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.304256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.304535 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.304802 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.305493 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:47.305793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.307850 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.322306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 115/229] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.322866 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.332614 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.333567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.334104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.334622 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.335545 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=8cefa19cfb5d43d3b1747b9677fc534e) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:47.336563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.339905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.346326 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 115/230] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/role_assignments?user.id=8cefa19cfb5d43d3b1747b9677fc534e&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.347421 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.513664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce8b64-9c4e-4886-ba76-3cb1d6a8b55c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.556455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.558460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.558947 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.559414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] PATH_INFO: `/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.560910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb837ddd7884ca79e1cdf0138f3ad9d)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.567245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23b830-5e9c-4aff-ad13-0e9cec65f4f1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.570222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.573045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 116/231] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:47.579061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.586066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.611779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:47.633301 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.634156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.634524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.634872 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c/users/bdb837ddd7884ca79e1cdf0138f3ad9d/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.637834 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27b46208a754c5cac9c139d839c088c, user_id=bdb837ddd7884ca79e1cdf0138f3ad9d, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.639526 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.654830 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 116/232] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:47 2022] PUT /identity/v3/projects/d27b46208a754c5cac9c139d839c088c/users/bdb837ddd7884ca79e1cdf0138f3ad9d/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:47.721814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33756d-0332-4b42-9ebe-6073342db901 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.758965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1f2ef-f647-40a9-8342-5c8b1852c8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.759996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1f2ef-f647-40a9-8342-5c8b1852c8bd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.760444 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1f2ef-f647-40a9-8342-5c8b1852c8bd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.760879 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1f2ef-f647-40a9-8342-5c8b1852c8bd None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.762376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1f2ef-f647-40a9-8342-5c8b1852c8bd None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.764100 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1f2ef-f647-40a9-8342-5c8b1852c8bd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.766440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 117/233] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:47 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:47.775097 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:47.922044 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6faafd9-4a60-4699-9dec-f661ff07d364 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:47.958719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f012a-a8d3-477b-a41e-bcb1f0300e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:47.959379 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f012a-a8d3-477b-a41e-bcb1f0300e58 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:47.959658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f012a-a8d3-477b-a41e-bcb1f0300e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:47.959926 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f012a-a8d3-477b-a41e-bcb1f0300e58 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c/users/bdb837ddd7884ca79e1cdf0138f3ad9d/roles/c30a3e1df1b74cd186fed662062d8e9d` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:47.962182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f012a-a8d3-477b-a41e-bcb1f0300e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27b46208a754c5cac9c139d839c088c, user_id=bdb837ddd7884ca79e1cdf0138f3ad9d, role_id=c30a3e1df1b74cd186fed662062d8e9d)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:47.963648 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f012a-a8d3-477b-a41e-bcb1f0300e58 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:47.991521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 117/234] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:47 2022] PUT /identity/v3/projects/d27b46208a754c5cac9c139d839c088c/users/bdb837ddd7884ca79e1cdf0138f3ad9d/roles/c30a3e1df1b74cd186fed662062d8e9d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:48.718561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ac69-3f92-4133-bb36-aa44c04180ca None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.719224 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ac69-3f92-4133-bb36-aa44c04180ca None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.719224 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ac69-3f92-4133-bb36-aa44c04180ca None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.720436 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 118/235] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:48.725834 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430486de-eb48-40c5-8f39-030fe6a84977 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.726121 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430486de-eb48-40c5-8f39-030fe6a84977 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.726396 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430486de-eb48-40c5-8f39-030fe6a84977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.746322 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-430486de-eb48-40c5-8f39-030fe6a84977 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:48.747632 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-430486de-eb48-40c5-8f39-030fe6a84977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:48.755935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ea6b2-d734-44a5-8d49-41dee6ab2e99 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.756212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ea6b2-d734-44a5-8d49-41dee6ab2e99 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.756479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ea6b2-d734-44a5-8d49-41dee6ab2e99 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.757953 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 119/236] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:48.763134 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0004-a3ca-4ab7-b96c-3dde033e13b9 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:48.763417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0004-a3ca-4ab7-b96c-3dde033e13b9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:48.763689 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf0004-a3ca-4ab7-b96c-3dde033e13b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:48.787364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-15cf0004-a3ca-4ab7-b96c-3dde033e13b9 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:48.788595 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-15cf0004-a3ca-4ab7-b96c-3dde033e13b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:48.829394 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:48.885682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 120/237] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:48.903294 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 118/238] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:49.296611 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0004-a3ca-4ab7-b96c-3dde033e13b9 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.298803 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.427162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf0004-a3ca-4ab7-b96c-3dde033e13b9 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.434361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430486de-eb48-40c5-8f39-030fe6a84977 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.484380 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.485649 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.486518 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.487112 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.508203 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:49.514057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:49.514942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:49.515735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 121/239] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:49.525808 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.577175 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430486de-eb48-40c5-8f39-030fe6a84977 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.618740 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.619379 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.619653 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.620184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.621418 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.622895 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.628691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 119/240] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:49.631123 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.657715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.697547 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bce650-4355-4092-8e86-140335e3e44d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.703560 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.735482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.736747 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.737254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.737801 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.738625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:49.739062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.740662 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.750452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 122/241] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:49.756054 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.830600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab035e-bca1-4120-a4b7-daa6d62ddf56 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.863116 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00dc6d-16ac-447b-aeca-4d0f08d62b49 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:49.897723 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:49.901188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.903645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.903926 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.904194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] PATH_INFO: `/v3/users/57e5ec2563c2447f8be610bad9801543` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.921743 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] RBAC: Authorizing `identity:get_user(user_id=57e5ec2563c2447f8be610bad9801543)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.923233 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.924951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 123/242] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/users/57e5ec2563c2447f8be610bad9801543 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:49.926268 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55072d90-25f8-4b1d-801d-e4d7d6f84f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:49.926903 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072d90-25f8-4b1d-801d-e4d7d6f84f2d None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:49.927181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072d90-25f8-4b1d-801d-e4d7d6f84f2d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:49.927452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55072d90-25f8-4b1d-801d-e4d7d6f84f2d None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:49.928099 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072d90-25f8-4b1d-801d-e4d7d6f84f2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:49.930389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:49.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55072d90-25f8-4b1d-801d-e4d7d6f84f2d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:49.983250 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 120/243] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:49 2022] POST /identity/v3/users => generated 293 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:02:50.085191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52b7a4-63de-4615-ad2c-68ab5987bf96 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.139573 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.140197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.140476 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.140748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.199006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:50.205050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8205be4-23a1-49c6-b459-a0060f4e0b16 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.205399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8205be4-23a1-49c6-b459-a0060f4e0b16 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.205635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8205be4-23a1-49c6-b459-a0060f4e0b16 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.207211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 121/244] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:50.212623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7be8-1db9-4be5-8001-8f4b8ae892d6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.212913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7be8-1db9-4be5-8001-8f4b8ae892d6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.213173 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe7be8-1db9-4be5-8001-8f4b8ae892d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.225450 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:50.230619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:50.238621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5afe7be8-1db9-4be5-8001-8f4b8ae892d6 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:50.240266 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5afe7be8-1db9-4be5-8001-8f4b8ae892d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:50.341125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 122/245] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:50.351313 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 124/246] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:50.357687 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7be8-1db9-4be5-8001-8f4b8ae892d6 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:50.390256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:50.474731 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe7be8-1db9-4be5-8001-8f4b8ae892d6 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.516060 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061a61e-432b-40b1-b6e4-834e844bfa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.516746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a61e-432b-40b1-b6e4-834e844bfa09 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.517028 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a61e-432b-40b1-b6e4-834e844bfa09 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.517297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061a61e-432b-40b1-b6e4-834e844bfa09 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.518479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061a61e-432b-40b1-b6e4-834e844bfa09 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:50.519919 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061a61e-432b-40b1-b6e4-834e844bfa09 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:50.521571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 123/247] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:50 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:50.528455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:50.566806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970328-07bb-4a4a-8740-202f5879b903 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.567111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970328-07bb-4a4a-8740-202f5879b903 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.567360 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c970328-07bb-4a4a-8740-202f5879b903 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.568703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 124/248] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:50.573901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d005-0397-437e-b3f4-40025c678751 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.574183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d005-0397-437e-b3f4-40025c678751 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.574459 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b8d005-0397-437e-b3f4-40025c678751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.602883 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-05b8d005-0397-437e-b3f4-40025c678751 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:50.604172 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-05b8d005-0397-437e-b3f4-40025c678751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:50.637759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:50.666092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09316b0-c6f5-402f-8c6e-8c0b91553b77 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.725576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.726204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.726476 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.726742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.727489 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] RBAC: Adding query filter params (role.id=5c86b05b98c743b68180b4256769d70a, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=57e5ec2563c2447f8be610bad9801543) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:50.727794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:50.729395 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:50.736445 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 125/249] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:50 2022] GET /identity/v3/role_assignments?user.id=57e5ec2563c2447f8be610bad9801543&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=5c86b05b98c743b68180b4256769d70a => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:50.739027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 125/250] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:50.767939 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:50.893723 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac383e4b-119e-4e82-a98a-eb686d238226 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:50.936606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:50.937278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.937548 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.937809 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.940899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051505d7-c5bc-4b3b-b13a-04cd47bcc0f1 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.941387 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051505d7-c5bc-4b3b-b13a-04cd47bcc0f1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.941594 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051505d7-c5bc-4b3b-b13a-04cd47bcc0f1 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.942896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 126/251] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:50.949201 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b20e-3f09-4f68-b46a-6ec1fceb23db None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:50.949515 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b20e-3f09-4f68-b46a-6ec1fceb23db None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:50.949794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6b20e-3f09-4f68-b46a-6ec1fceb23db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:50.953461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:50.958922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:50.959836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:50.960638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:50.965194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 126/252] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:50.966840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:50.991902 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:50.994567 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b7d6b20e-3f09-4f68-b46a-6ec1fceb23db None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:50.996251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b7d6b20e-3f09-4f68-b46a-6ec1fceb23db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:51.036937 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:51.081354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f35891-e26c-4a60-847f-48cd7dde0e03 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:51.135508 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 127/253] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:51.141357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:51.141357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:51.141357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:51.141357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:51.141714 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:51.141714 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:51.141714 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:51.159612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 127/254] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:51.164887 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b20e-3f09-4f68-b46a-6ec1fceb23db None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:51.167968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:51.330693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:51.381191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6b20e-3f09-4f68-b46a-6ec1fceb23db None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:51.400479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d4ed6b-4834-4831-a62a-cbe9b597fba3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:51.460068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:51.461656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:51.462154 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:51.462623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] PATH_INFO: `/v3/users/8cefa19cfb5d43d3b1747b9677fc534e` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:51.466266 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] RBAC: Authorizing `identity:get_user(user_id=8cefa19cfb5d43d3b1747b9677fc534e)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:51.467930 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:51.470055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 128/255] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:51 2022] GET /identity/v3/users/8cefa19cfb5d43d3b1747b9677fc534e => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:51.475142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:51.475423 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:51.476067 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:51.476346 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:51.476618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:51.499337 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:51.505559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:51.506457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:51.507234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 128/256] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:02:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:02:51.515518 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:51.526975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:51.653083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04051d1d-d809-4e89-8f78-5676f6c87b69 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:51.681739 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:51.690644 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:51.691265 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:51.691696 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:51.692093 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:51.692788 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:51.693097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:51.694705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:51.705741 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 129/257] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:51.707077 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:51.744254 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f1f81-dec3-4b19-92f0-3b0b48ab078b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:51.816532 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc4f1d6-5841-4211-887f-ff836075afe0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:51.830077 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:51.830726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:51.831157 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:51.831433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:51.832596 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:51.834258 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:51.836191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 129/258] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:51 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:51.836969 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:51.853234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:51.853913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:51.854188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:51.854455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:51.865043 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:51.869821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:51.870728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:51.871508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 130/259] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:02:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:51.872159 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:51.933777 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:51.976567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd89b6-920f-4594-9c56-551e9fb7586e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.013274 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:52.014130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.014510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.014883 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c/users/8cefa19cfb5d43d3b1747b9677fc534e/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.016936 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27b46208a754c5cac9c139d839c088c, user_id=8cefa19cfb5d43d3b1747b9677fc534e, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:52.018542 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:52.021671 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:52.031591 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee0d0e-b613-408e-8c97-59ab2c2c444f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.034496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 131/260] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:51 2022] PUT /identity/v3/projects/d27b46208a754c5cac9c139d839c088c/users/8cefa19cfb5d43d3b1747b9677fc534e/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:02:52.035577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:52.106572 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:52.107273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.107543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.107821 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] PATH_INFO: `/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.109887 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] RBAC: Authorizing `identity:get_user(user_id=bdb837ddd7884ca79e1cdf0138f3ad9d)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:52.111391 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:52.113210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 130/261] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:51 2022] GET /identity/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:52.118447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:52.245919 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade56886-fe49-4b17-b35a-68719b40d373 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.269827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:52.297198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:52.297840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.298124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.298396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.299072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:52.299373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:52.300759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:52.320513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 132/262] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:02:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:52.327266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:52.350018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fac990-5db0-4bcf-83d1-42e592955ce9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.411825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:52.412451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.412731 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.413004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.465802 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1aeffd-1f78-47ad-a483-e8b9900d6669 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.474069 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:52.504118 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:52.505053 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.505567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.506002 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] PATH_INFO: `/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.507652 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] RBAC: Authorizing `identity:get_user(user_id=bdb837ddd7884ca79e1cdf0138f3ad9d)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:52.509437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:52.512378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 133/263] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:52 2022] GET /identity/v3/users/bdb837ddd7884ca79e1cdf0138f3ad9d => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:52.526348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:52.549034 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:52.550690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:52.574870 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:52.639964 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256ff52-dedd-43d7-8164-3b541eabe77b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.673294 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 131/264] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:52.676648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:52.677256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.677585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.678678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:52.681507 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.739851 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:52.758563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:52.760518 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:52.783924 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3b060-21e8-4e3a-9306-a73de4579795 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.821347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:52.821860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:52.821860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:52.821860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:52.821860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:52.822162 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:52.823699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:52.826107 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 132/265] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:52 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:52.837347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:52.902763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 134/266] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:02:52.910572 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:52.939745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3e1e9-d99e-4a1e-ae37-0b2d682a86c7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:52.992668 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:53.016592 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:53.017273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.017639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.017916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.020053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=bdb837ddd7884ca79e1cdf0138f3ad9d) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:53.020362 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:53.021863 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:53.032398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 133/267] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:52 2022] GET /identity/v3/role_assignments?user.id=bdb837ddd7884ca79e1cdf0138f3ad9d&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:53.100238 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3ad05-c091-4a95-949d-7429c568894a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:53.149377 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e1ce1-ade2-45c8-938c-0d747fd9607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:53.150648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ce1-ade2-45c8-938c-0d747fd9607c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.151128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ce1-ade2-45c8-938c-0d747fd9607c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.151715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e1ce1-ade2-45c8-938c-0d747fd9607c None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.153101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1ce1-ade2-45c8-938c-0d747fd9607c None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:53.154830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e1ce1-ade2-45c8-938c-0d747fd9607c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:53.157131 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 135/268] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:52 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:53.166717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:53.328341 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf57b5-c8a1-4b8a-9f33-7568a5786449 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:53.374140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9e5e3-1b3e-4226-8f5f-a60d0c53f33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:53.374686 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e5e3-1b3e-4226-8f5f-a60d0c53f33e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.374964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e5e3-1b3e-4226-8f5f-a60d0c53f33e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.375233 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e5e3-1b3e-4226-8f5f-a60d0c53f33e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.375968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9e5e3-1b3e-4226-8f5f-a60d0c53f33e None admin] RBAC: Adding query filter params (role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=bdb837ddd7884ca79e1cdf0138f3ad9d) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:53.376299 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9e5e3-1b3e-4226-8f5f-a60d0c53f33e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:53.377834 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9e5e3-1b3e-4226-8f5f-a60d0c53f33e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:53.385120 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 134/269] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:53 2022] GET /identity/v3/role_assignments?user.id=bdb837ddd7884ca79e1cdf0138f3ad9d&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:53.776441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce563ec-7236-4193-b25e-a18133c493a6 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.777506 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce563ec-7236-4193-b25e-a18133c493a6 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.777813 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce563ec-7236-4193-b25e-a18133c493a6 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.779490 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 136/270] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:53.784515 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff190-1618-4cf6-87f4-eecfa68edb3a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.784795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff190-1618-4cf6-87f4-eecfa68edb3a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.785067 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ff190-1618-4cf6-87f4-eecfa68edb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.793856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e79281-ae8b-40fc-a2b9-68970b43d0f6 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.794140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e79281-ae8b-40fc-a2b9-68970b43d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.794395 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e79281-ae8b-40fc-a2b9-68970b43d0f6 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.795886 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 137/271] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:53.801500 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d2ac3-3790-48fc-a2cf-6614e1ff9851 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:53.801782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d2ac3-3790-48fc-a2cf-6614e1ff9851 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:53.802053 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d2ac3-3790-48fc-a2cf-6614e1ff9851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:53.811128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-2b4ff190-1618-4cf6-87f4-eecfa68edb3a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:53.812314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-2b4ff190-1618-4cf6-87f4-eecfa68edb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:53.822170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d81d2ac3-3790-48fc-a2cf-6614e1ff9851 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:53.824590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d81d2ac3-3790-48fc-a2cf-6614e1ff9851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:53.827576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:53.878950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:53.896968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 135/272] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:53.918525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 138/273] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:54.180807 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2453-4721-4666-a8b6-c2f6b5bc784e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.181273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2453-4721-4666-a8b6-c2f6b5bc784e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.181374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff2453-4721-4666-a8b6-c2f6b5bc784e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.182849 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 136/274] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:54.188614 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c900-e795-4381-bd1d-cd531d5cb02a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.188900 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c900-e795-4381-bd1d-cd531d5cb02a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.189173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c900-e795-4381-bd1d-cd531d5cb02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.208830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c8c6c900-e795-4381-bd1d-cd531d5cb02a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:54.210314 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c8c6c900-e795-4381-bd1d-cd531d5cb02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:54.266127 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2453-4721-4666-a8b6-c2f6b5bc784e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.285479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 139/275] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:54.285479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c900-e795-4381-bd1d-cd531d5cb02a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.376173 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff2453-4721-4666-a8b6-c2f6b5bc784e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.378484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.423194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.424206 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.424727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.425191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.425594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c900-e795-4381-bd1d-cd531d5cb02a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.426741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.428575 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.435763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 137/276] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:54.436931 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.470959 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.471953 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.472451 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.472915 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.484151 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:54.489460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:54.490341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:54.491141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:54.493434 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 140/277] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:54.500578 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.511792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.567522 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c859b-d321-4c97-ba9e-5a112fc1e14d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.615583 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.616187 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.616461 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.616735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.617425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.618984 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.622206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a651e-d540-4ce2-b85c-fe85304e7a48 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.642367 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 138/278] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:02:54 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:54.643023 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.659355 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.669299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.669954 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.670229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.670495 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.671173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:54.671469 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.672954 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.682369 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 141/279] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:54.688290 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.800957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68649-a8e8-49de-96f1-2621310a7fe0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.813463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5581be6-bba2-420b-9786-862337f6d60b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:54.831514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:54.847367 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.848152 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.848440 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.849556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.855703 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:54.856437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:54.857492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:54.857492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] PATH_INFO: `/v3/users/57e5ec2563c2447f8be610bad9801543` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:54.858314 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] RBAC: Authorizing `identity:get_user(user_id=57e5ec2563c2447f8be610bad9801543)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:54.859745 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:54.862629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 142/280] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/users/57e5ec2563c2447f8be610bad9801543 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:54.864104 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:54.868431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:54.869288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:54.870403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 139/281] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:54.871810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.876286 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:54.946666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:55.006054 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2165a3d-c0e9-4588-9553-1737ea4b5d1c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.014373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4b19c-7f32-4ac4-94b5-6ad49c97cdb4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.056841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cb0c0-0b9a-4773-ae6f-8d53f28858fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.058357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cb0c0-0b9a-4773-ae6f-8d53f28858fb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.059008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cb0c0-0b9a-4773-ae6f-8d53f28858fb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.059471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cb0c0-0b9a-4773-ae6f-8d53f28858fb None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.060039 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.060537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cb0c0-0b9a-4773-ae6f-8d53f28858fb None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:55.060814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.061157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.061381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cb0c0-0b9a-4773-ae6f-8d53f28858fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.062594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.063140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cb0c0-0b9a-4773-ae6f-8d53f28858fb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.063895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.065620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.068008 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 143/282] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:55.073363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 140/283] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:55.073728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:55.078826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26973-fc6b-4ae2-a794-74e2c75b9c74 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.079442 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26973-fc6b-4ae2-a794-74e2c75b9c74 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.079817 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26973-fc6b-4ae2-a794-74e2c75b9c74 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.081477 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 141/284] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:55.084837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf26973-fc6b-4ae2-a794-74e2c75b9c74 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:55.123805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:55.200976 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1236872-d05b-4c11-8a9f-95d7ce9365c0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.223698 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf26973-fc6b-4ae2-a794-74e2c75b9c74 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.230724 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:55.243682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1bd82-3ff3-4588-a1d1-400bd446f3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.244962 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1bd82-3ff3-4588-a1d1-400bd446f3e4 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.246653 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1bd82-3ff3-4588-a1d1-400bd446f3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.247268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1bd82-3ff3-4588-a1d1-400bd446f3e4 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c/users/57e5ec2563c2447f8be610bad9801543/roles/5c86b05b98c743b68180b4256769d70a` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.250550 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1bd82-3ff3-4588-a1d1-400bd446f3e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27b46208a754c5cac9c139d839c088c, user_id=57e5ec2563c2447f8be610bad9801543, role_id=5c86b05b98c743b68180b4256769d70a)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.253188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1bd82-3ff3-4588-a1d1-400bd446f3e4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.272050 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 144/285] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:02:55 2022] PUT /identity/v3/projects/d27b46208a754c5cac9c139d839c088c/users/57e5ec2563c2447f8be610bad9801543/roles/5c86b05b98c743b68180b4256769d70a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:55.273644 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.275244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109f954-5122-4a46-81ad-149d07a88872 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.276026 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.276469 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.276912 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] PATH_INFO: `/v3/users/9cec347eda9e4cd6ae06e1cef4f93a40` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.277512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109f954-5122-4a46-81ad-149d07a88872 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.277997 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109f954-5122-4a46-81ad-149d07a88872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.298812 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] RBAC: Authorizing `identity:get_user(user_id=9cec347eda9e4cd6ae06e1cef4f93a40)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.300580 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.301923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d109f954-5122-4a46-81ad-149d07a88872 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:55.302899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 142/286] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:55 2022] GET /identity/v3/users/9cec347eda9e4cd6ae06e1cef4f93a40 => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:55.303555 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d109f954-5122-4a46-81ad-149d07a88872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:55.310871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:55.456453 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 145/287] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:55.489747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:55.500218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffff056-8899-42a1-bf04-9e884697d8fd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.551359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.552295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.552801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.553258 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:55.554188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, user.id=9cec347eda9e4cd6ae06e1cef4f93a40, scope.system=all) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:55.554684 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:55.556313 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:55.562893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 143/288] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 17 16:02:55 2022] GET /identity/v3/role_assignments?user.id=9cec347eda9e4cd6ae06e1cef4f93a40&scope.system=all&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 226 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:55.852137 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109f954-5122-4a46-81ad-149d07a88872 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:55.960817 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109f954-5122-4a46-81ad-149d07a88872 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:55.996805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:55.997476 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:55.997755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:55.998025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:56.000812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:56.013653 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:56.018950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:56.019816 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:56.020602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 146/289] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:56.027605 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:56.170784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468dcafc-7567-4601-842b-33bd2fef0ce2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:56.217152 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:56.217844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:56.218121 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:56.218384 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:56.219041 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:56.219335 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:56.220701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:56.235204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 144/290] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:56.240521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:56.352427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01e10c-287d-4bac-ab1e-38840f76953c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:56.391813 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:56.392434 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:56.392708 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:56.392977 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] PATH_INFO: `/v3/users/8cefa19cfb5d43d3b1747b9677fc534e` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:56.394143 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] RBAC: Authorizing `identity:get_user(user_id=8cefa19cfb5d43d3b1747b9677fc534e)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:56.395575 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:56.397219 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 147/291] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:56 2022] GET /identity/v3/users/8cefa19cfb5d43d3b1747b9677fc534e => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:56.403088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:56.438393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:56.558430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85492adc-99d5-4589-a1b2-4045332e5564 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:56.603674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:56.604274 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:56.604551 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:56.604859 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:56.685133 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:56.686691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:56.704703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:56.821374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 145/292] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:56.827131 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:56.905446 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:56.966780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c5492-46bc-45a0-b3ed-23f7a8e913a8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.002475 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cb05b-c656-4878-ac5d-bb1c09b7997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.003109 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cb05b-c656-4878-ac5d-bb1c09b7997c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.003389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cb05b-c656-4878-ac5d-bb1c09b7997c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.003658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cb05b-c656-4878-ac5d-bb1c09b7997c None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.004781 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cb05b-c656-4878-ac5d-bb1c09b7997c None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:57.006320 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cb05b-c656-4878-ac5d-bb1c09b7997c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:57.008258 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 148/293] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:56 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:57.014932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:57.172500 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d873ab-598a-4048-9ad4-62f554388777 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:57.190082 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:57.215255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c47d7-c7f2-4114-bf28-a53bdc855f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:57.215857 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c47d7-c7f2-4114-bf28-a53bdc855f0d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.216134 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c47d7-c7f2-4114-bf28-a53bdc855f0d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.216398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c47d7-c7f2-4114-bf28-a53bdc855f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.217173 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c47d7-c7f2-4114-bf28-a53bdc855f0d None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=8cefa19cfb5d43d3b1747b9677fc534e) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:57.217444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c47d7-c7f2-4114-bf28-a53bdc855f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:57.218872 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c47d7-c7f2-4114-bf28-a53bdc855f0d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:57.228602 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 146/294] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:57 2022] GET /identity/v3/role_assignments?user.id=8cefa19cfb5d43d3b1747b9677fc534e&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:57.636937 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ec81-dd34-4fa7-bded-e6d78eba114e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.637178 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ec81-dd34-4fa7-bded-e6d78eba114e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.637470 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9ec81-dd34-4fa7-bded-e6d78eba114e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.639183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 149/295] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:57.644695 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5755b1-4d8a-4813-a2e4-6abbfc6b5c89 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.645155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5755b1-4d8a-4813-a2e4-6abbfc6b5c89 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.645227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5755b1-4d8a-4813-a2e4-6abbfc6b5c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.665239 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-2d5755b1-4d8a-4813-a2e4-6abbfc6b5c89 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:57.666604 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-2d5755b1-4d8a-4813-a2e4-6abbfc6b5c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:57.747145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 147/296] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:57.784254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c28db-0d7e-4cbe-bc49-7cb36bc54456 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.784557 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c28db-0d7e-4cbe-bc49-7cb36bc54456 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.784792 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c28db-0d7e-4cbe-bc49-7cb36bc54456 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.786155 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 150/297] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:57.791240 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3efa0-7842-4bc4-a839-f7df7b23c041 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:57.791526 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3efa0-7842-4bc4-a839-f7df7b23c041 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:57.791797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3efa0-7842-4bc4-a839-f7df7b23c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:57.815168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-94e3efa0-7842-4bc4-a839-f7df7b23c041 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:57.816357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-94e3efa0-7842-4bc4-a839-f7df7b23c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:57.894871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 148/298] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:58.112431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c28db-0d7e-4cbe-bc49-7cb36bc54456 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.132368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed71e6-791c-434c-9509-3254a2f500e1 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.132702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed71e6-791c-434c-9509-3254a2f500e1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.132978 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed71e6-791c-434c-9509-3254a2f500e1 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.134339 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 149/299] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:02:58.139890 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09f06-684e-4454-8347-d384a7129e33 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.140177 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09f06-684e-4454-8347-d384a7129e33 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.140558 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09f06-684e-4454-8347-d384a7129e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.161103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-16d09f06-684e-4454-8347-d384a7129e33 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:58.162736 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-16d09f06-684e-4454-8347-d384a7129e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:58.210556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.230277 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c28db-0d7e-4cbe-bc49-7cb36bc54456 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.247396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.255341 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 150/300] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:02:58.277058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.277716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.277989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.278251 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.280635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09f06-684e-4454-8347-d384a7129e33 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.291471 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:58.298681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:58.299552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:58.300333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:58.300935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 151/301] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:58.306639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.393116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09f06-684e-4454-8347-d384a7129e33 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.424171 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a188a-3549-4fa4-9481-238533b0972c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.430104 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e513b-23e4-400f-baa4-7836e9d55760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.430731 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e513b-23e4-400f-baa4-7836e9d55760 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.431005 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e513b-23e4-400f-baa4-7836e9d55760 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.431268 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e513b-23e4-400f-baa4-7836e9d55760 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.432886 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e513b-23e4-400f-baa4-7836e9d55760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.434697 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e513b-23e4-400f-baa4-7836e9d55760 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.441342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 151/302] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:58.441342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161a11-4c71-42b6-83c4-43a23df97ebc None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.441342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161a11-4c71-42b6-83c4-43a23df97ebc None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.441342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87161a11-4c71-42b6-83c4-43a23df97ebc None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.441342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 152/303] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:02:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:02:58.444112 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161a11-4c71-42b6-83c4-43a23df97ebc None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.464838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653dda66-2cb1-49fd-8de6-c113b192fe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.465490 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dda66-2cb1-49fd-8de6-c113b192fe7e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.465773 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dda66-2cb1-49fd-8de6-c113b192fe7e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.466046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653dda66-2cb1-49fd-8de6-c113b192fe7e None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.466762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dda66-2cb1-49fd-8de6-c113b192fe7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:58.467068 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dda66-2cb1-49fd-8de6-c113b192fe7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.468431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653dda66-2cb1-49fd-8de6-c113b192fe7e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.476868 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 152/304] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:58.477934 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715b64-3399-45aa-a781-542d7ccb161e None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.478163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715b64-3399-45aa-a781-542d7ccb161e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.478432 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99715b64-3399-45aa-a781-542d7ccb161e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.488167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.497901 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-99715b64-3399-45aa-a781-542d7ccb161e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:02:58.499084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-99715b64-3399-45aa-a781-542d7ccb161e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:02:58.529684 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.553879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87161a11-4c71-42b6-83c4-43a23df97ebc None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.579189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 153/305] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:02:58.580023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99715b64-3399-45aa-a781-542d7ccb161e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.601078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.601900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.602168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.602431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] PATH_INFO: `/v3/groups` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.603368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.605690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.623676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 153/306] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 17 16:02:58 2022] POST /identity/v3/groups => generated 229 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:02:58.634583 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.699420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99715b64-3399-45aa-a781-542d7ccb161e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.741129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.742262 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.742750 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.743255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] PATH_INFO: `/v3/users/57e03668790747aeaf47371c386bc4a6` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.759117 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] RBAC: Authorizing `identity:get_user(user_id=57e03668790747aeaf47371c386bc4a6)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.761059 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.763165 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 154/307] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/users/57e03668790747aeaf47371c386bc4a6 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:58.769632 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.780635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.786957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154d72a-5425-42ac-8d7c-8cef445e4503 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.809194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:58.834373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.835245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.835668 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.835939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.849122 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:58.856330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:58.857210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:02:58.858296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:02:58.862283 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 154/308] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:58.865031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.906427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc38c30-9cac-4bbf-bc24-734ead93aa54 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:58.942516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:58.943115 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:58.943388 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:58.943654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:58.944359 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] RBAC: Adding query filter params (role.id=5c86b05b98c743b68180b4256769d70a, user.id=57e03668790747aeaf47371c386bc4a6, scope.system=all) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:58.944656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:58.946456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:58.951878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 155/309] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/role_assignments?user.id=57e03668790747aeaf47371c386bc4a6&scope.system=all&role.id=5c86b05b98c743b68180b4256769d70a => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:58.952452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:58.991041 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144ecc3-ba39-470d-a152-2025b558cb96 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.042620 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.043847 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.044124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.044389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.045374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.046166 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.047935 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.061816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 155/310] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:59.067232 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.081914 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.101733 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f6f2-55e1-462d-a274-86a9d6f1c4c8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.103996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.142033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.143309 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.143771 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.144046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.157016 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:02:59.162503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:02:59.163416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:02:59.164198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 156/311] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:02:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:02:59.169626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.209220 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f13f49-c373-4a2c-9a60-947728423176 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.249632 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.250269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.250544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.250815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] PATH_INFO: `/v3/users/57e5ec2563c2447f8be610bad9801543` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.252038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] RBAC: Authorizing `identity:get_user(user_id=57e5ec2563c2447f8be610bad9801543)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.253456 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.259779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 156/312] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/users/57e5ec2563c2447f8be610bad9801543 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:59.261881 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.310325 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e6344-fe7b-4704-8db3-3ec3a05d5d89 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.345402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.346067 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.346333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.346606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.347301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.347621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.348994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.362825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 157/313] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:59.364126 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.375933 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.377589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.391721 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb770bab-7f87-430d-ad25-abfd292bc49e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.431400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.432348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.433071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.433579 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.474515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e76dc-f643-4a32-aad9-50bc84bd5770 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.509982 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.512340 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.526384 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.527833 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.528220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.528493 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] PATH_INFO: `/v3/users/9cec347eda9e4cd6ae06e1cef4f93a40` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.529647 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] RBAC: Authorizing `identity:get_user(user_id=9cec347eda9e4cd6ae06e1cef4f93a40)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.531091 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.532871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 158/314] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/users/9cec347eda9e4cd6ae06e1cef4f93a40 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:02:59.538098 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.611145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.618903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:02:59.627594 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 157/315] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:02:59.637508 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.644393 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5494db-05a8-4050-8fef-ba86a8c44173 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.679065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.679715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.679981 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.680517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] PATH_INFO: `/v3/system/users/9cec347eda9e4cd6ae06e1cef4f93a40/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.681693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9cec347eda9e4cd6ae06e1cef4f93a40, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.683832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.694722 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 159/316] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 17 16:02:59 2022] PUT /identity/v3/system/users/9cec347eda9e4cd6ae06e1cef4f93a40/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:02:59.750796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26f6ff-0a00-4778-88f4-a634552e9576 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.790900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31e7c2-1d7f-4751-8aad-d183f627d15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.793056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31e7c2-1d7f-4751-8aad-d183f627d15a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.793583 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31e7c2-1d7f-4751-8aad-d183f627d15a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.794001 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31e7c2-1d7f-4751-8aad-d183f627d15a None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.795602 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31e7c2-1d7f-4751-8aad-d183f627d15a None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.797261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31e7c2-1d7f-4751-8aad-d183f627d15a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.803237 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 158/317] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:02:59.806599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:02:59.920880 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb8b63-0158-4dd5-9575-5bfcad37cfbc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:02:59.955782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d5aca-b3aa-4c58-a03a-40e028a54e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:02:59.956388 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5aca-b3aa-4c58-a03a-40e028a54e93 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:02:59.956668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5aca-b3aa-4c58-a03a-40e028a54e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:02:59.956939 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d5aca-b3aa-4c58-a03a-40e028a54e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:02:59.957697 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5aca-b3aa-4c58-a03a-40e028a54e93 None admin] RBAC: Adding query filter params (role.id=5c86b05b98c743b68180b4256769d70a, scope.project.id=d27b46208a754c5cac9c139d839c088c, user.id=57e5ec2563c2447f8be610bad9801543) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:02:59.958005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5aca-b3aa-4c58-a03a-40e028a54e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:02:59.959454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65d5aca-b3aa-4c58-a03a-40e028a54e93 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:02:59.969449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 160/318] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:02:59 2022] GET /identity/v3/role_assignments?user.id=57e5ec2563c2447f8be610bad9801543&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=5c86b05b98c743b68180b4256769d70a => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:00.966878 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ac6a-3196-4661-84b6-0cd9f54276a3 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.967427 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ac6a-3196-4661-84b6-0cd9f54276a3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.967427 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858ac6a-3196-4661-84b6-0cd9f54276a3 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.970302 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 159/319] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:00.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb31c8-9747-449a-94ac-2c5eb55fdcb4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:00.977221 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb31c8-9747-449a-94ac-2c5eb55fdcb4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:00.977435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb31c8-9747-449a-94ac-2c5eb55fdcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:00.988828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.003551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1ceb31c8-9747-449a-94ac-2c5eb55fdcb4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:01.004724 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1ceb31c8-9747-449a-94ac-2c5eb55fdcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:01.075196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 161/320] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:01.218908 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660aa38-f092-4ef8-920b-63e0a17c0a5a None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.219192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660aa38-f092-4ef8-920b-63e0a17c0a5a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.219374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660aa38-f092-4ef8-920b-63e0a17c0a5a None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.220836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 160/321] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:01.225773 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7c8c-9d4b-4fd6-a657-586984cdec82 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.226059 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7c8c-9d4b-4fd6-a657-586984cdec82 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.226329 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb7c8c-9d4b-4fd6-a657-586984cdec82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.244970 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-6cdb7c8c-9d4b-4fd6-a657-586984cdec82 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:01.246378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-6cdb7c8c-9d4b-4fd6-a657-586984cdec82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:01.317721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 162/322] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:01.403836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660aa38-f092-4ef8-920b-63e0a17c0a5a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.461941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.508169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660aa38-f092-4ef8-920b-63e0a17c0a5a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.543709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.544329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.544602 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.544867 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.545965 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.547403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.549095 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 161/323] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:01.554537 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb7c8c-9d4b-4fd6-a657-586984cdec82 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.616676 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.647893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.656068 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb7c8c-9d4b-4fd6-a657-586984cdec82 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.693491 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.694111 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.694374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.694648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] PATH_INFO: `/v3/groups` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.695273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.696693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:01.716575 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 163/324] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 17 16:03:01 2022] POST /identity/v3/groups => generated 226 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:01.758339 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653c527-2b87-443e-9857-d60540a770a1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.787353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.802056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa184fe2-32b1-45d0-ac49-6ba13f6f53fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.803109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184fe2-32b1-45d0-ac49-6ba13f6f53fc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.803584 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184fe2-32b1-45d0-ac49-6ba13f6f53fc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.804198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa184fe2-32b1-45d0-ac49-6ba13f6f53fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.817176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa184fe2-32b1-45d0-ac49-6ba13f6f53fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-fa184fe2-32b1-45d0-ac49-6ba13f6f53fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:01.822682 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:01.824083 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:03:01.824900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:01.825537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 162/325] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:01.830873 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:01.950962 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fc934-fb9f-43ad-8c3e-28d7494a1ac6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:01.977179 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:01.990639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:01.991250 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:01.991525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:01.991812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:01.995081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:01.995081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:01.995081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.005005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 164/326] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:02.005170 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc81d-1e4e-4ec0-9cc8-cc06b046f2e9 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.005633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc81d-1e4e-4ec0-9cc8-cc06b046f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.005787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbc81d-1e4e-4ec0-9cc8-cc06b046f2e9 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.008505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 163/327] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:02.012656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.013694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba74dba-9264-4298-94e9-523cfc3add24 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.013973 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba74dba-9264-4298-94e9-523cfc3add24 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.014244 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba74dba-9264-4298-94e9-523cfc3add24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.036330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-9ba74dba-9264-4298-94e9-523cfc3add24 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:02.037775 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-9ba74dba-9264-4298-94e9-523cfc3add24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:02.128674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 164/328] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:02.145512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332d27e-1dea-44b9-b13e-295a90f6363f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.188882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.189845 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.190328 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.190771 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] PATH_INFO: `/v3/users/57e03668790747aeaf47371c386bc4a6` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.192079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] RBAC: Authorizing `identity:get_user(user_id=57e03668790747aeaf47371c386bc4a6)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.193806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.196012 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 165/329] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/users/57e03668790747aeaf47371c386bc4a6 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:02.201956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba74dba-9264-4298-94e9-523cfc3add24 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.319593 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba74dba-9264-4298-94e9-523cfc3add24 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.337747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.361965 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.362619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.362897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.363171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] PATH_INFO: `/v3/system/users/57e03668790747aeaf47371c386bc4a6/roles/5c86b05b98c743b68180b4256769d70a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.366068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=57e03668790747aeaf47371c386bc4a6, role_id=5c86b05b98c743b68180b4256769d70a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.367465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.378012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 165/330] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 17 16:03:02 2022] PUT /identity/v3/system/users/57e03668790747aeaf47371c386bc4a6/roles/5c86b05b98c743b68180b4256769d70a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:03:02.508767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.584821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:02.643252 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f7c00-f349-4120-9196-839f8898b288 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.679674 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.680299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.680572 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.680835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.694768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:02.700464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:02.701357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:02.702176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 166/331] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:02.707489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:02.826922 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eebb831-66f5-46d4-9430-6354faccf854 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:02.867081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:02.867605 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:02.867880 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:02.868147 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:02.868804 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:02.869103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:02.870547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:02.879070 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 166/332] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:02.884765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:03.007107 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e34f20-50c4-45b3-a05a-69d4b58df077 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:03.022702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:03.050340 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bed3f-20d8-48a3-9494-29e1cfebe8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:03.051076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bed3f-20d8-48a3-9494-29e1cfebe8f0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.051353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bed3f-20d8-48a3-9494-29e1cfebe8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.051618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bed3f-20d8-48a3-9494-29e1cfebe8f0 None admin] PATH_INFO: `/v3/users/9cec347eda9e4cd6ae06e1cef4f93a40` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.052753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bed3f-20d8-48a3-9494-29e1cfebe8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=9cec347eda9e4cd6ae06e1cef4f93a40)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:03.054205 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bed3f-20d8-48a3-9494-29e1cfebe8f0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:03.056065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 167/333] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:03:02 2022] GET /identity/v3/users/9cec347eda9e4cd6ae06e1cef4f93a40 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:03.061993 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:03.137829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:03.219560 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916b02e-b070-428b-95e2-892b065db244 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:03.258234 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2316c-8cd6-4f91-9386-31e35c9984c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:03.258838 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2316c-8cd6-4f91-9386-31e35c9984c7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:03.259113 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2316c-8cd6-4f91-9386-31e35c9984c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:03.259381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2316c-8cd6-4f91-9386-31e35c9984c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:03.260105 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2316c-8cd6-4f91-9386-31e35c9984c7 None admin] RBAC: Adding query filter params (role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, user.id=9cec347eda9e4cd6ae06e1cef4f93a40, scope.system=all) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:03.260410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2316c-8cd6-4f91-9386-31e35c9984c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:03.261926 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2316c-8cd6-4f91-9386-31e35c9984c7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:03.275210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 167/334] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 17 16:03:03 2022] GET /identity/v3/role_assignments?user.id=9cec347eda9e4cd6ae06e1cef4f93a40&scope.system=all&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:05.061464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c9cf4-ca62-4397-ba29-a1dfb25a2f22 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.062043 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c9cf4-ca62-4397-ba29-a1dfb25a2f22 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.062043 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c9cf4-ca62-4397-ba29-a1dfb25a2f22 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.063541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 168/335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:05.070278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0103ac2-ca0a-4d1e-b407-4f24ca06aedb None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.070904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0103ac2-ca0a-4d1e-b407-4f24ca06aedb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.070904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0103ac2-ca0a-4d1e-b407-4f24ca06aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.091811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f0103ac2-ca0a-4d1e-b407-4f24ca06aedb None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:05.093093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f0103ac2-ca0a-4d1e-b407-4f24ca06aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:05.175793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 168/336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:05.427101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df172d-f474-498d-af04-d51f6256cb2a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.427455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df172d-f474-498d-af04-d51f6256cb2a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.427631 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df172d-f474-498d-af04-d51f6256cb2a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.429124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 169/337] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:05.434224 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671923f-221b-406a-b4b6-6fed06def2d4 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.434510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671923f-221b-406a-b4b6-6fed06def2d4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.434785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7671923f-221b-406a-b4b6-6fed06def2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.454681 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7671923f-221b-406a-b4b6-6fed06def2d4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:05.455859 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7671923f-221b-406a-b4b6-6fed06def2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:05.475079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e269e-6492-4152-a5ba-c21632c074ee None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.475392 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e269e-6492-4152-a5ba-c21632c074ee None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.475614 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e269e-6492-4152-a5ba-c21632c074ee None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.477259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 170/338] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:05.482627 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34245-097b-40c6-a3c9-f9fc09ca4051 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.482903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34245-097b-40c6-a3c9-f9fc09ca4051 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.483173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d34245-097b-40c6-a3c9-f9fc09ca4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.487502 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:05.522739 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-20d34245-097b-40c6-a3c9-f9fc09ca4051 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:05.523952 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-20d34245-097b-40c6-a3c9-f9fc09ca4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:05.615791 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 169/339] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:05.624755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 171/340] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:05.678673 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671923f-221b-406a-b4b6-6fed06def2d4 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.728328 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc552cd-499d-4e89-a9ae-c30e3211c7bd None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.728648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc552cd-499d-4e89-a9ae-c30e3211c7bd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.728915 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc552cd-499d-4e89-a9ae-c30e3211c7bd None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.730897 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 172/341] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:05.736487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea0ff-d5eb-4609-bce8-1206adbaf3f1 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.736763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea0ff-d5eb-4609-bce8-1206adbaf3f1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.737034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea0ff-d5eb-4609-bce8-1206adbaf3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.772879 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e9cea0ff-d5eb-4609-bce8-1206adbaf3f1 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:05.774099 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e9cea0ff-d5eb-4609-bce8-1206adbaf3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:05.805242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7671923f-221b-406a-b4b6-6fed06def2d4 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:05.851859 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:05.852483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:05.852751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:05.853012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:05.879049 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:05.885409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:05.887735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:05.889727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 170/342] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:05.894287 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:05.913850 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 173/343] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:05.920339 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.033477 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fe90f-f1b6-4a6d-a2a7-51046430b391 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.072683 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.073988 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.074309 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.074790 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.075513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.075811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.077202 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.086045 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 171/344] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:06.092023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cea0ff-d5eb-4609-bce8-1206adbaf3f1 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.116609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.171370 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.221885 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.250311 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff92edc-7cb5-4a4b-be47-c8345569d6c6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.270462 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cea0ff-d5eb-4609-bce8-1206adbaf3f1 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.305856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.307363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.308956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.310237 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.312070 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.314345 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.314844 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.315304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.336411 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:06.345815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:06.346691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 16:03:06.347450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:06.352110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 172/345] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:06.354690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.451034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.452840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.503866 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.523869 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121ba55-f373-44d0-96e7-a13373585e2b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.566235 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.567248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.567745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.568550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.582626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 174/346] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:06.582838 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.582931 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.588371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:06.595751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:06.596677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:06.597505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:06.599150 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 173/347] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:06.604234 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.703784 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f562630-820b-42b8-a4c8-079dd1e995fd None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.719998 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffac8c3-9fe6-49e6-ad9f-7d27c61984b2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.746581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.747350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.747688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.748024 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.749772 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:06.749772 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.750498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.761767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 175/348] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.762424 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.768130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.782556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.782556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.782556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.782556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.798693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:06.804696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:06.805793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 174/349] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:06.806582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:06.892721 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:06.908781 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dd620-c248-46db-ba16-8be50b299cf1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.953151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a20ca4-be23-4082-bdd5-2cf312fdce69 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:06.968146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257bb01-83f3-43b7-9839-56c5d641a5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:06.968764 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257bb01-83f3-43b7-9839-56c5d641a5ba None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.969768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257bb01-83f3-43b7-9839-56c5d641a5ba None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.970477 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257bb01-83f3-43b7-9839-56c5d641a5ba None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.972070 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257bb01-83f3-43b7-9839-56c5d641a5ba None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:06.974368 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257bb01-83f3-43b7-9839-56c5d641a5ba None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:06.975814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 176/350] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:06.976968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0e09-4edc-45b4-a205-6b8d3e338990 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:06.977253 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0e09-4edc-45b4-a205-6b8d3e338990 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:06.977552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb0e09-4edc-45b4-a205-6b8d3e338990 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:06.978739 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 177/351] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:06.979487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0e09-4edc-45b4-a205-6b8d3e338990 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.009279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.009934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.010212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.010481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.011991 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:07.012242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.013645 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.022971 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 175/352] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.025486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.089529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.132795 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb0e09-4edc-45b4-a205-6b8d3e338990 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.168448 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e5c32-1a9a-484b-b033-43b98bafb252 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.179972 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.180736 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.181418 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.181790 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] PATH_INFO: `/v3/users/57e03668790747aeaf47371c386bc4a6` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.184377 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] RBAC: Authorizing `identity:get_user(user_id=57e03668790747aeaf47371c386bc4a6)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.187197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.190467 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 178/353] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 17 16:03:06 2022] GET /identity/v3/users/57e03668790747aeaf47371c386bc4a6 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.191624 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.206146 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.220699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9c8e9-ddc5-4274-ae2e-db8c4450de0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.221623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9c8e9-ddc5-4274-ae2e-db8c4450de0e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.222094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9c8e9-ddc5-4274-ae2e-db8c4450de0e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.222534 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9c8e9-ddc5-4274-ae2e-db8c4450de0e None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.223370 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9c8e9-ddc5-4274-ae2e-db8c4450de0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:07.224448 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9c8e9-ddc5-4274-ae2e-db8c4450de0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.226381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9c8e9-ddc5-4274-ae2e-db8c4450de0e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.239188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 176/354] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.239986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a9f7-1c56-4c47-8a33-816a21d8d5e0 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.240278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a9f7-1c56-4c47-8a33-816a21d8d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.240549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a9f7-1c56-4c47-8a33-816a21d8d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.270236 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bcd4a9f7-1c56-4c47-8a33-816a21d8d5e0 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:07.271956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bcd4a9f7-1c56-4c47-8a33-816a21d8d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:07.327270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce22d23-b4e5-409a-a1e2-b3c5f4efea2a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.351530 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 177/355] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:07.353554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4a9f7-1c56-4c47-8a33-816a21d8d5e0 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.367625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.368133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.368406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.368672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.377000 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.379629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.382766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 179/356] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.382766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.388416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.482746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4a9f7-1c56-4c47-8a33-816a21d8d5e0 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.500796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.518184 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413a4f32-277e-4e15-8c2d-a4bcfc1e4b68 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.533399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095de8c5-9ff9-433a-9171-cf29793b2d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.534393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de8c5-9ff9-433a-9171-cf29793b2d47 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.534878 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de8c5-9ff9-433a-9171-cf29793b2d47 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.535361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095de8c5-9ff9-433a-9171-cf29793b2d47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.562140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.562667 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.562949 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.563222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.564077 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] RBAC: Adding query filter params (role.id=5c86b05b98c743b68180b4256769d70a, user.id=57e03668790747aeaf47371c386bc4a6, scope.system=all) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:07.564386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.565988 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.580096 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 180/357] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/role_assignments?user.id=57e03668790747aeaf47371c386bc4a6&scope.system=all&role.id=5c86b05b98c743b68180b4256769d70a => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.581012 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.615349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095de8c5-9ff9-433a-9171-cf29793b2d47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.617485 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095de8c5-9ff9-433a-9171-cf29793b2d47 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.653648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.703836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346ff15-f65b-47b3-a065-c5c3428b17b6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.754165 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.754781 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.755059 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.755331 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.768885 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 178/358] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:07.770383 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d2659-9795-4e39-93af-20ac0a116d9f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.770667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d2659-9795-4e39-93af-20ac0a116d9f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.770934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d2659-9795-4e39-93af-20ac0a116d9f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.772342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 179/359] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:07.773062 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d2659-9795-4e39-93af-20ac0a116d9f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:07.796752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.863909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.865721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.904816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d2659-9795-4e39-93af-20ac0a116d9f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:07.951965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:07.953099 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:07.954001 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:07.954509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:07.955008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:07.955745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=6523217f47c448f6abb285a0acc204dc) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:07.956047 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:07.957548 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:07.963190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 180/360] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:07.964029 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.006890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 181/361] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:08.007782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.102700 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.127259 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8043b5-9812-4e84-ab96-57071a0a50d7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.153125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37f2c8-7e8e-4ef0-95c6-ca13e699cacb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.178979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b732b8-f87b-4923-8992-27b8c672fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.179629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b732b8-f87b-4923-8992-27b8c672fff1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.180219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b732b8-f87b-4923-8992-27b8c672fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.180219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b732b8-f87b-4923-8992-27b8c672fff1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.193876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b732b8-f87b-4923-8992-27b8c672fff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:08.196456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.197084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.197403 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.197678 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.198847 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f4b732b8-f87b-4923-8992-27b8c672fff1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:08.200081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:08.200963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:08.201822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:08.202424 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.202490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 181/362] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:08.202552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 182/363] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.203517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.203625 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0ea1-5242-41da-9266-1a28f4f296fd None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.203625 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0ea1-5242-41da-9266-1a28f4f296fd None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.203625 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0ea1-5242-41da-9266-1a28f4f296fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.227478 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-997a0ea1-5242-41da-9266-1a28f4f296fd None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:08.228699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-997a0ea1-5242-41da-9266-1a28f4f296fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:08.249806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.313789 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 182/364] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:08.318227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a0ea1-5242-41da-9266-1a28f4f296fd None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.353412 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df962e-da8a-4cfb-8abf-fc9e84c44b01 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.395600 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.396603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.397073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.397587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.398909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.400773 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.403603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 183/365] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.404623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.409505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.452171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a0ea1-5242-41da-9266-1a28f4f296fd None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.504297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.505594 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.506082 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.506540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.507396 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:08.507898 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.509568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.520272 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 183/366] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.521449 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.539259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.545705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94733add-a349-4115-b0d8-9492d65798fa None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.598166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.599183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.599662 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.600221 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.601672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.603401 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.606453 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 184/367] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.608568 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.658320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1e49a-accc-4d60-8059-d6d2e9c25f07 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.694081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.705832 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.706757 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.707038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.707311 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.708560 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.710732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.718012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 184/368] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.718012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:08.736728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de2cc3-bc94-4898-a926-e690dbcc09e8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.780307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.780913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.781186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.781486 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.827843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:08.841250 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a44af-29a2-4619-8de8-202a3a8d11a9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:08.876045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.877039 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.890726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:08.891605 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:08.892053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:08.892493 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:08.893535 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=d27b46208a754c5cac9c139d839c088c) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:08.894077 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:08.895717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:08.902547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 185/369] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:08.903371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.009036 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.033287 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 185/370] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:09.036515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.079635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d2557-fa9c-4dd8-a8cf-8a6866ed89fe None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.114733 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.131105 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.132100 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.132581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.133052 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.150297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:09.156285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:09.157192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:09.158454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 186/371] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:09.159106 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.166790 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff816bc-3334-4576-b861-70c7a847769a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.213516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.214262 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.214599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.214871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.215765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=6523217f47c448f6abb285a0acc204dc) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:09.216074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.217693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.224080 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 186/372] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:09.225011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.284338 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8019a-dd29-4053-bf08-3a52503651de None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.322072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.339532 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.340347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.346216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.346611 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.348278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.349604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2441c5f-26d1-4e86-b807-c021479230dd None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.349792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.351690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 187/373] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:09.369589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.395033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.407754 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.408378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.408653 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.408926 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.409638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:09.409937 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.411317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.431639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 187/374] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:09.438722 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.556058 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55eb32-3d43-4027-8a80-7079fa78fa60 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.565641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212b7cb-6161-44d5-9b61-03b9a36bf7b1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.604020 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.605519 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.605803 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.606073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.622963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.623650 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.623923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.624243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.625565 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.627014 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.628877 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 188/375] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:09.647416 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:09.744601 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.761714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:09.765379 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.766884 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.838796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5bd8-d623-48a7-bc4b-59d1c584b764 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:09.889822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:09.890434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:09.890710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:09.890975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:09.891701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=d27b46208a754c5cac9c139d839c088c) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:09.892004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:09.899286 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:09.910303 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 189/376] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 260 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:09.953281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 188/377] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:09.959017 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.123668 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c897b-07ce-413f-ae0b-e6ee2c9bf7ef None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.160081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.176832 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.177534 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.177817 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.178089 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] PATH_INFO: `/v3/projects/35b16f4dab55413091c1b8347836e133` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.179445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] RBAC: Authorizing `identity:get_project(project_id=35b16f4dab55413091c1b8347836e133)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.180913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.184604 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 190/378] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:09 2022] GET /identity/v3/projects/35b16f4dab55413091c1b8347836e133 => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:10.189442 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.340625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:10.351474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9f58b-73e3-418d-8a7e-03ba8d650f9f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.399514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb0c2d-fb98-4349-ac1b-4bf02d1a0faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.400401 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb0c2d-fb98-4349-ac1b-4bf02d1a0faa None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.400673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb0c2d-fb98-4349-ac1b-4bf02d1a0faa None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.400941 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb0c2d-fb98-4349-ac1b-4bf02d1a0faa None admin] PATH_INFO: `/v3/groups/326bb5697c654601bb14cbea6c69df5b` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.412754 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb0c2d-fb98-4349-ac1b-4bf02d1a0faa None admin] RBAC: Authorizing `identity:get_group(group_id=326bb5697c654601bb14cbea6c69df5b)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.414333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb0c2d-fb98-4349-ac1b-4bf02d1a0faa None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.416298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 189/379] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/groups/326bb5697c654601bb14cbea6c69df5b => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:10.422073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:10.548020 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca2d4-60e6-411e-8d9e-244892138f11 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.548389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca2d4-60e6-411e-8d9e-244892138f11 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.548590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ca2d4-60e6-411e-8d9e-244892138f11 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.550231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 190/380] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:10.553979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae27f4b-f0c2-41ec-a45d-add68196d204 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:10.556123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42cfd0-2550-4d20-8960-f67088224a32 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.556406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42cfd0-2550-4d20-8960-f67088224a32 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.556673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42cfd0-2550-4d20-8960-f67088224a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.593648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-fa42cfd0-2550-4d20-8960-f67088224a32 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:10.594845 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-fa42cfd0-2550-4d20-8960-f67088224a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:10.613480 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:10.614141 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:10.614422 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:10.614691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:10.615414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] RBAC: Adding query filter params (group.id=326bb5697c654601bb14cbea6c69df5b, role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=35b16f4dab55413091c1b8347836e133) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:10.615777 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:10.617217 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:10.629715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 191/381] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:10 2022] GET /identity/v3/role_assignments?group.id=326bb5697c654601bb14cbea6c69df5b&scope.project.id=35b16f4dab55413091c1b8347836e133&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:10.707859 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 191/382] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:11.170316 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.237718 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.299944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f3ca3-370e-477e-8326-01e3fae1ab00 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.343621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.344267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.344546 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.344816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.361288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:11.366794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:11.367717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:11.369130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 192/383] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:11.374188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42cfd0-2550-4d20-8960-f67088224a32 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.487639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.506916 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42cfd0-2550-4d20-8960-f67088224a32 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.558968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7ebf4-d31d-4892-a116-75423923edca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.559587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ebf4-d31d-4892-a116-75423923edca None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.559861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ebf4-d31d-4892-a116-75423923edca None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.560130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7ebf4-d31d-4892-a116-75423923edca None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.560796 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7ebf4-d31d-4892-a116-75423923edca None admin] RBAC: Adding query filter params (name=member) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:11.561097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7ebf4-d31d-4892-a116-75423923edca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.562495 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7ebf4-d31d-4892-a116-75423923edca None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.576315 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 192/384] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:11.581482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.597310 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef2b92-fdf2-411d-9bf9-cd39a28ee3bd None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.597623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef2b92-fdf2-411d-9bf9-cd39a28ee3bd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.597886 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef2b92-fdf2-411d-9bf9-cd39a28ee3bd None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.599454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 193/385] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:11.604301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74d14-7b9c-4fd8-b077-831c73cb74ef None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.604708 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74d14-7b9c-4fd8-b077-831c73cb74ef None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.604979 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a74d14-7b9c-4fd8-b077-831c73cb74ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.626096 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c4a74d14-7b9c-4fd8-b077-831c73cb74ef None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:11.627267 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c4a74d14-7b9c-4fd8-b077-831c73cb74ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:11.754965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 194/386] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:11.764381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab43701-9acf-485e-b8b7-ff6848066efd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:11.785338 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.809605 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:11.814043 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:11.814317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:11.814586 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:11.815779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:11.817206 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:11.819146 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 193/387] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:11.824421 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74d14-7b9c-4fd8-b077-831c73cb74ef None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:11.935206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:11.967905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a74d14-7b9c-4fd8-b077-831c73cb74ef None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.011979 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f290a256-3e64-47f8-acc0-fcc932e44c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.012629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a256-3e64-47f8-acc0-fcc932e44c19 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.012905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a256-3e64-47f8-acc0-fcc932e44c19 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.013177 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290a256-3e64-47f8-acc0-fcc932e44c19 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.018075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290a256-3e64-47f8-acc0-fcc932e44c19 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.019447 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f290a256-3e64-47f8-acc0-fcc932e44c19 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.021473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 195/388] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:11 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:12.028144 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.150522 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad147-7661-4582-8fa6-e4ff8cb48515 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.150867 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad147-7661-4582-8fa6-e4ff8cb48515 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.151063 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad147-7661-4582-8fa6-e4ff8cb48515 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.152624 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 196/389] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:12.173240 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e44928-8191-4195-bd46-c7683d568338 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.181956 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bad147-7661-4582-8fa6-e4ff8cb48515 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.213072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377548-1e1d-475d-a221-fea64a93f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.213940 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377548-1e1d-475d-a221-fea64a93f998 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.214224 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377548-1e1d-475d-a221-fea64a93f998 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.214499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377548-1e1d-475d-a221-fea64a93f998 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc/groups/a65cccf2a33243708e3b9d418bff31bb/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.216759 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377548-1e1d-475d-a221-fea64a93f998 None admin] RBAC: Authorizing `identity:create_grant(project_id=6523217f47c448f6abb285a0acc204dc, group_id=a65cccf2a33243708e3b9d418bff31bb, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.218416 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377548-1e1d-475d-a221-fea64a93f998 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.237581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 194/390] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 17 16:03:12 2022] PUT /identity/v3/projects/6523217f47c448f6abb285a0acc204dc/groups/a65cccf2a33243708e3b9d418bff31bb/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:12.238991 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66d0d-3c0c-43ff-911c-9b4c05fb2bbb None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.239445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66d0d-3c0c-43ff-911c-9b4c05fb2bbb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.239727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae66d0d-3c0c-43ff-911c-9b4c05fb2bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.262941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5ae66d0d-3c0c-43ff-911c-9b4c05fb2bbb None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:12.264166 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5ae66d0d-3c0c-43ff-911c-9b4c05fb2bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:12.309081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.350457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 195/391] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:12.386662 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bad147-7661-4582-8fa6-e4ff8cb48515 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.441636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.442259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.442529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.442792 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.467083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:12.471848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:12.472702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:12.474686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 197/392] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:12.479028 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66d0d-3c0c-43ff-911c-9b4c05fb2bbb None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.613401 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae66d0d-3c0c-43ff-911c-9b4c05fb2bbb None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.649255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968acd2a-39dd-4722-b007-c3bbafe2539e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.649896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968acd2a-39dd-4722-b007-c3bbafe2539e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.650435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968acd2a-39dd-4722-b007-c3bbafe2539e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.650704 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968acd2a-39dd-4722-b007-c3bbafe2539e None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.651443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968acd2a-39dd-4722-b007-c3bbafe2539e None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:12.651743 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968acd2a-39dd-4722-b007-c3bbafe2539e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.653135 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968acd2a-39dd-4722-b007-c3bbafe2539e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.662457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 196/393] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:12.668713 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.683300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.722270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d84ea-d5a7-4ff5-acdd-33974dbac962 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.722636 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d84ea-d5a7-4ff5-acdd-33974dbac962 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.722975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d84ea-d5a7-4ff5-acdd-33974dbac962 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.724529 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 197/394] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:12.729169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea79-51c0-41ac-9dec-141a1f29de1b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.730096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea79-51c0-41ac-9dec-141a1f29de1b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.730434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45ea79-51c0-41ac-9dec-141a1f29de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.749787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4b45ea79-51c0-41ac-9dec-141a1f29de1b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:12.751070 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4b45ea79-51c0-41ac-9dec-141a1f29de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:12.795248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:12.828731 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adbc69-53c2-4b39-b294-418813277ce4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:12.858897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 198/395] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:12.860213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ea79-51c0-41ac-9dec-141a1f29de1b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.875183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:12.875839 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:12.876179 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:12.876517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:12.877852 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:12.879431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:12.881391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 198/396] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:12.887278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:12.984014 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45ea79-51c0-41ac-9dec-141a1f29de1b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.028004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.028941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.029316 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.029719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.043316 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:13.049732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:13.050624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:13.051410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:13.054737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.055816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 199/397] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:13.058343 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.084432 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a12d68-03f4-47c0-a614-b16cc3e745ed None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.092179 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.121894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.122923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.123402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.123863 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.125242 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.126925 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.128837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 199/398] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:12 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.134771 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.185364 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ef03ee-d039-43a5-8ebb-6606c4c08bdb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.253746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.254359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.254636 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.254907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.255577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.255877 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.257262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.267966 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 200/399] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.274892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.391221 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a6668-957d-4b37-9c54-f0cf59641af5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.391641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdc79a-0a15-4d24-8326-fd804a6fe5c2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.392849 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.443059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.443690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.443967 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.444237 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.446008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.447726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.451038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 201/400] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:13.451829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.460779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc3d00f-614a-4205-8f5f-63a3a252e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.461469 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3d00f-614a-4205-8f5f-63a3a252e5fa None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.461744 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3d00f-614a-4205-8f5f-63a3a252e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.462018 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc3d00f-614a-4205-8f5f-63a3a252e5fa None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c/groups/a65cccf2a33243708e3b9d418bff31bb/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.464586 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3d00f-614a-4205-8f5f-63a3a252e5fa None admin] RBAC: Authorizing `identity:create_grant(project_id=d27b46208a754c5cac9c139d839c088c, group_id=a65cccf2a33243708e3b9d418bff31bb, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.466050 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc3d00f-614a-4205-8f5f-63a3a252e5fa None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.479765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 200/401] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 17 16:03:13 2022] PUT /identity/v3/projects/d27b46208a754c5cac9c139d839c088c/groups/a65cccf2a33243708e3b9d418bff31bb/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:13.481076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6214c-1674-44b6-a9c2-52daabfd0d3c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.481368 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6214c-1674-44b6-a9c2-52daabfd0d3c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.481635 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6214c-1674-44b6-a9c2-52daabfd0d3c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.486957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 201/402] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:13.486957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6214c-1674-44b6-a9c2-52daabfd0d3c None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.491115 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.608882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecc2d4-d5d7-4d5b-8258-56ecbcf23c27 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.621011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6214c-1674-44b6-a9c2-52daabfd0d3c None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.651320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.652740 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.653215 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.653651 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.663292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48bf64-4bc5-41b3-a955-02a1f505c68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.663915 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48bf64-4bc5-41b3-a955-02a1f505c68f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.664186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48bf64-4bc5-41b3-a955-02a1f505c68f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.664453 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48bf64-4bc5-41b3-a955-02a1f505c68f None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.665589 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48bf64-4bc5-41b3-a955-02a1f505c68f None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.667447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:13.668895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48bf64-4bc5-41b3-a955-02a1f505c68f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.674577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 202/403] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.674577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191c8d-abb6-4a76-9a66-86cc128cb2d0 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.674577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191c8d-abb6-4a76-9a66-86cc128cb2d0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.674577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4191c8d-abb6-4a76-9a66-86cc128cb2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:13.676273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:13.677151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:13.677970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 202/404] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:13.678645 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.694140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a4191c8d-abb6-4a76-9a66-86cc128cb2d0 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:13.695622 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a4191c8d-abb6-4a76-9a66-86cc128cb2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:13.700514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.779067 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:13.784291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 203/405] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:13.785307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191c8d-abb6-4a76-9a66-86cc128cb2d0 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:13.828573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e676b7-621c-48f7-a8df-713fb7b9a0d9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.894576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.895701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.896183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.896654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc/groups/a65cccf2a33243708e3b9d418bff31bb/roles/c30a3e1df1b74cd186fed662062d8e9d` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.904527 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] RBAC: Authorizing `identity:create_grant(project_id=6523217f47c448f6abb285a0acc204dc, group_id=a65cccf2a33243708e3b9d418bff31bb, role_id=c30a3e1df1b74cd186fed662062d8e9d)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.906473 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.915011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4191c8d-abb6-4a76-9a66-86cc128cb2d0 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:13.941336 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 203/406] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 17 16:03:13 2022] PUT /identity/v3/projects/6523217f47c448f6abb285a0acc204dc/groups/a65cccf2a33243708e3b9d418bff31bb/roles/c30a3e1df1b74cd186fed662062d8e9d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:13.962438 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:13.963176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:13.963457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:13.964354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:13.965095 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:13.965437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:13.966911 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:13.984018 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 204/407] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:13.994025 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.124641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.164640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73784ce-fda8-4c7b-be08-832a46fd2c99 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.213472 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.214670 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.215176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.215659 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.217010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.218688 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.222598 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.222994 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 204/408] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:13 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:14.255133 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.322376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.386518 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7edcfc-7ba0-4fe7-a8d2-6b5ef9b9e240 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.423305 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40602928-dcf0-46c8-8a85-1928e0f4e3f3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.460410 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.461772 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.462500 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.464399 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.486808 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:14.497314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.498291 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:14.499157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:14.500019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:14.500820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:14.502250 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.502774 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.504757 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 205/409] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:14.505718 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.507434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.509691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 205/410] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:14.518371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.518524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.542227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.675685 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21737db1-1b00-4830-bc94-bdec73d9dc11 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.701477 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:14.716176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.717275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.717841 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.718331 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c/groups/a65cccf2a33243708e3b9d418bff31bb/roles/c30a3e1df1b74cd186fed662062d8e9d` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.720977 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27b46208a754c5cac9c139d839c088c, group_id=a65cccf2a33243708e3b9d418bff31bb, role_id=c30a3e1df1b74cd186fed662062d8e9d)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.722859 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.740848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 206/411] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 17 16:03:14 2022] PUT /identity/v3/projects/d27b46208a754c5cac9c139d839c088c/groups/a65cccf2a33243708e3b9d418bff31bb/roles/c30a3e1df1b74cd186fed662062d8e9d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:14.748562 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63865ac-44c6-4c18-b48c-795ca969c7d7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.794138 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b30797-f7a4-4a49-a12b-b4c426d5a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:14.794763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b30797-f7a4-4a49-a12b-b4c426d5a489 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.795040 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b30797-f7a4-4a49-a12b-b4c426d5a489 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.795308 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b30797-f7a4-4a49-a12b-b4c426d5a489 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.795986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b30797-f7a4-4a49-a12b-b4c426d5a489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:14.796339 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b30797-f7a4-4a49-a12b-b4c426d5a489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:14.797948 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b30797-f7a4-4a49-a12b-b4c426d5a489 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:14.808835 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 206/412] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:14.814902 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:14.966734 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0530e-a448-4580-9e28-51263b8d3c56 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:14.986344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b0d1-9f5f-419c-83b0-14f175fd7f11 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.986632 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b0d1-9f5f-419c-83b0-14f175fd7f11 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.986902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5b0d1-9f5f-419c-83b0-14f175fd7f11 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:14.988518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 207/413] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:14.994452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ed57f-74cd-4793-a951-e1755d35ecc8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:14.994737 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ed57f-74cd-4793-a951-e1755d35ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:14.995106 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ed57f-74cd-4793-a951-e1755d35ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.005272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.006395 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.006873 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.007358 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] PATH_INFO: `/v3/groups/326bb5697c654601bb14cbea6c69df5b` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.008677 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] RBAC: Authorizing `identity:get_group(group_id=326bb5697c654601bb14cbea6c69df5b)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.010422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.012827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 207/414] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:14 2022] GET /identity/v3/groups/326bb5697c654601bb14cbea6c69df5b => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:15.018164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-863ed57f-74cd-4793-a951-e1755d35ecc8 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:15.018437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.019420 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-863ed57f-74cd-4793-a951-e1755d35ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:15.089699 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.098039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 208/415] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:15.131559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd841f-a601-4d5a-ba17-7efad313a737 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.167550 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.168517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.169019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.169560 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] PATH_INFO: `/v3/projects/35b16f4dab55413091c1b8347836e133` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.170889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] RBAC: Authorizing `identity:get_project(project_id=35b16f4dab55413091c1b8347836e133)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.172582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.174782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 208/416] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/projects/35b16f4dab55413091c1b8347836e133 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:15.186390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ed57f-74cd-4793-a951-e1755d35ecc8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.188987 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.326008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ed57f-74cd-4793-a951-e1755d35ecc8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.364077 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.364746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.365020 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.365291 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] PATH_INFO: `/v3/projects/35b16f4dab55413091c1b8347836e133/groups/326bb5697c654601bb14cbea6c69df5b/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.367207 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] RBAC: Authorizing `identity:create_grant(project_id=35b16f4dab55413091c1b8347836e133, group_id=326bb5697c654601bb14cbea6c69df5b, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.368637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:15.383897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 209/417] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 17 16:03:15 2022] PUT /identity/v3/projects/35b16f4dab55413091c1b8347836e133/groups/326bb5697c654601bb14cbea6c69df5b/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:15.580766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.708445 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0abb5f-3953-4cfc-ab47-0a43e29d0614 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.726913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.745630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.746577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.747084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.747551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.758234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:15.764615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:15.765570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:15.766365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:15.768997 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 209/418] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:15.774466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:15.886433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:15.933791 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61328680-d584-4b9c-a7fd-335d168d904c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:15.981453 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93047-4b87-4bc3-a1f4-55f46f8bf990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:15.982077 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93047-4b87-4bc3-a1f4-55f46f8bf990 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:15.982354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93047-4b87-4bc3-a1f4-55f46f8bf990 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:15.982623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93047-4b87-4bc3-a1f4-55f46f8bf990 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:15.983291 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93047-4b87-4bc3-a1f4-55f46f8bf990 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:15.983589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93047-4b87-4bc3-a1f4-55f46f8bf990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:15.984953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93047-4b87-4bc3-a1f4-55f46f8bf990 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.002398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 210/419] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.007774 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.019706 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6ec9-5818-4f89-94ea-b387a8fbe3b0 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.020009 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6ec9-5818-4f89-94ea-b387a8fbe3b0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.020262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c6ec9-5818-4f89-94ea-b387a8fbe3b0 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.022352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 211/420] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:16.028576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00af3-859a-4fce-976c-d8a51750bd38 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.028855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00af3-859a-4fce-976c-d8a51750bd38 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.029125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c00af3-859a-4fce-976c-d8a51750bd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.064342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-e0c00af3-859a-4fce-976c-d8a51750bd38 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:16.068134 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e0c00af3-859a-4fce-976c-d8a51750bd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:16.170823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b75381-d1dd-4af7-9f58-c83a587dc275 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.193487 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 212/421] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:16.224501 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.225516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.226012 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.226491 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.275903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.300954 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.302809 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.436849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 210/422] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:16.442310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c00af3-859a-4fce-976c-d8a51750bd38 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.544668 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.589311 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c00af3-859a-4fce-976c-d8a51750bd38 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.627415 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.628073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.628346 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.628613 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.629744 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.631178 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.633071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 213/423] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.642407 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.702354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.775365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.817058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d6255-d76e-4837-b4db-c035ad61cee7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.818130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c635bc-a273-4fd2-a5ee-baae8ba33e7e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:16.854438 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:16.856581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7358f5-f9b5-4942-95bf-6af29fdba67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.857553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7358f5-f9b5-4942-95bf-6af29fdba67e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.858266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7358f5-f9b5-4942-95bf-6af29fdba67e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.858784 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7358f5-f9b5-4942-95bf-6af29fdba67e None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.860176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7358f5-f9b5-4942-95bf-6af29fdba67e None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:16.861863 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7358f5-f9b5-4942-95bf-6af29fdba67e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:16.863542 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 211/424] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:16.864852 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466230-4f64-43ff-8830-b41fc808b057 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.865135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466230-4f64-43ff-8830-b41fc808b057 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.865429 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32466230-4f64-43ff-8830-b41fc808b057 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.867346 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 212/425] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:16.869113 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ad73-52e8-4423-ab70-14e8e02c1bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:16.869676 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32466230-4f64-43ff-8830-b41fc808b057 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:16.870645 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ad73-52e8-4423-ab70-14e8e02c1bbf None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.871183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ad73-52e8-4423-ab70-14e8e02c1bbf None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.871546 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ad73-52e8-4423-ab70-14e8e02c1bbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.883204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ad73-52e8-4423-ab70-14e8e02c1bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f177ad73-52e8-4423-ab70-14e8e02c1bbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:16.889279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:16.890399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 16:03:16.891393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:16.897352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 214/426] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:16.897352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e6c2e-5021-4282-b067-60d895e4fc2b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:16.897352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e6c2e-5021-4282-b067-60d895e4fc2b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:16.897352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e6c2e-5021-4282-b067-60d895e4fc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:16.914929 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-881e6c2e-5021-4282-b067-60d895e4fc2b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:16.916249 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-881e6c2e-5021-4282-b067-60d895e4fc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:17.006927 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 215/427] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:17.008068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e6c2e-5021-4282-b067-60d895e4fc2b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.008350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32466230-4f64-43ff-8830-b41fc808b057 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.051983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.052561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.052899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.053173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.054111 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=6523217f47c448f6abb285a0acc204dc) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:17.054449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.056173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.063633 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 213/428] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:16 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:17.209861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e6c2e-5021-4282-b067-60d895e4fc2b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.232989 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.262133 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.262985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.263412 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.263823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.264621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] RBAC: Adding query filter params (name=member) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:17.265060 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.266770 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.282079 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 216/429] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:17.288234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.310519 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.425049 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216aadae-4ed4-4840-9c9d-f11d418ce9a5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.463161 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decc572-fdb1-4096-9aac-9fd334060169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.464452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decc572-fdb1-4096-9aac-9fd334060169 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.464748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decc572-fdb1-4096-9aac-9fd334060169 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.465024 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decc572-fdb1-4096-9aac-9fd334060169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.468981 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.566566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decc572-fdb1-4096-9aac-9fd334060169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.567935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decc572-fdb1-4096-9aac-9fd334060169 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.582355 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.626601 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e8772-73d0-4965-8c6a-37aeda206f14 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.674202 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.674838 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.675116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.675384 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.690113 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:17.695421 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 214/430] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:17.696630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:17.697725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:17.698552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:17.699161 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 217/431] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:17.700641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b452be-e2a8-42f4-89a5-460145434f29 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.701120 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b452be-e2a8-42f4-89a5-460145434f29 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.701220 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.701681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b452be-e2a8-42f4-89a5-460145434f29 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.703298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 215/432] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:17.708415 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b452be-e2a8-42f4-89a5-460145434f29 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:17.753963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.838240 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac413e18-b6b1-49bc-adc5-f531c1fbad53 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.847632 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b452be-e2a8-42f4-89a5-460145434f29 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:17.863519 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:17.877509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62f44f-c018-4af2-bd2c-939ebd082c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.878144 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62f44f-c018-4af2-bd2c-939ebd082c56 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.878517 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62f44f-c018-4af2-bd2c-939ebd082c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.878989 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62f44f-c018-4af2-bd2c-939ebd082c56 None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.879926 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62f44f-c018-4af2-bd2c-939ebd082c56 None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.882505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62f44f-c018-4af2-bd2c-939ebd082c56 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.884110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 218/433] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:17.885152 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc0b6b-815f-4434-8964-940363a75955 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.885598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc0b6b-815f-4434-8964-940363a75955 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.885837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc0b6b-815f-4434-8964-940363a75955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.904550 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:17.905178 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:17.905491 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:17.905761 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:17.905948 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a9dc0b6b-815f-4434-8964-940363a75955 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:17.906445 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:17.906741 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:17.907185 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a9dc0b6b-815f-4434-8964-940363a75955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:17.908147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:17.917945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 216/434] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:17.919073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.001850 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 219/435] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:18.003772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc0b6b-815f-4434-8964-940363a75955 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.035903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3569f3-39db-4917-adca-1dad1ce40328 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.050191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.075293 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f55bb-e6da-418e-a997-64ce4d3e7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.075919 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f55bb-e6da-418e-a997-64ce4d3e7772 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.076248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f55bb-e6da-418e-a997-64ce4d3e7772 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.076461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f55bb-e6da-418e-a997-64ce4d3e7772 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.077923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f55bb-e6da-418e-a997-64ce4d3e7772 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.079168 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f55bb-e6da-418e-a997-64ce4d3e7772 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.080940 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 217/436] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:17 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:18.081839 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb615-54cc-4883-aee0-6faae3797541 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.082116 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb615-54cc-4883-aee0-6faae3797541 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.082464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cb615-54cc-4883-aee0-6faae3797541 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.083758 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 218/437] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:18.086923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cb615-54cc-4883-aee0-6faae3797541 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.132584 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.144903 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc0b6b-815f-4434-8964-940363a75955 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.180837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.182128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.182858 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.183131 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.194717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cb615-54cc-4883-aee0-6faae3797541 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.234256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cf1a3-221e-41ea-92e8-897b4e706136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.234865 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf1a3-221e-41ea-92e8-897b4e706136 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.235142 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf1a3-221e-41ea-92e8-897b4e706136 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.235414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cf1a3-221e-41ea-92e8-897b4e706136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.236139 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cf1a3-221e-41ea-92e8-897b4e706136 None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267, scope.project.id=d27b46208a754c5cac9c139d839c088c) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:18.236445 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cf1a3-221e-41ea-92e8-897b4e706136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.237948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cf1a3-221e-41ea-92e8-897b4e706136 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.243923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 219/438] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:18.245095 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f646-00de-49f1-98da-810ba2bb099e None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.245397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f646-00de-49f1-98da-810ba2bb099e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.245671 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864f646-00de-49f1-98da-810ba2bb099e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.266237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a864f646-00de-49f1-98da-810ba2bb099e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:18.267033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a864f646-00de-49f1-98da-810ba2bb099e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:18.269435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.272495 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.348734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.361723 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 220/439] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:18.361723 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f646-00de-49f1-98da-810ba2bb099e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.415914 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 220/440] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:18.416090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.421361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.496246 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864f646-00de-49f1-98da-810ba2bb099e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.537065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.537722 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.538003 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.538274 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.549916 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:18.550322 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd7d70a-f5f3-460d-880d-be63623bfa20 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:18.554665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:18.555718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:18.556668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 221/441] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:18.561529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.585946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.592590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.593216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.593525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.593798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] PATH_INFO: `/v3/projects/6523217f47c448f6abb285a0acc204dc` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.594924 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=6523217f47c448f6abb285a0acc204dc)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.596363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.598170 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 221/442] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/projects/6523217f47c448f6abb285a0acc204dc => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:18.603297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.672307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.679616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71447c-b985-44cb-85e9-c9f307054145 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.713393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81cd8e-0036-4828-aa85-765f99e94dd8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.714806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.715412 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.715690 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.715954 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.716610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:18.716908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.718298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.726195 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 222/443] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:18.726976 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.750365 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.750994 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.751269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.751543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.752647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.754155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.760366 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 222/444] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:18.760366 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.822156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.826333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241c7dd-7537-485f-ab98-db8fa92a50fa None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.858152 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5f8ac-145c-4750-97da-5f8f98169abb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:18.859584 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.860195 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.860468 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.860734 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.871391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:18.877191 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:18.878147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:18.878942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 223/445] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:18.879793 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:18.896124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:18.896726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:18.896997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:18.897261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:18.898313 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:18.965998 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:18.967457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:18.981270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b9ce32-e39e-4455-a91f-9f7e8867d000 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.014774 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.015431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.015710 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.015980 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.016695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=6523217f47c448f6abb285a0acc204dc) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.016997 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.018458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.024189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 224/446] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=6523217f47c448f6abb285a0acc204dc&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.024189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.041372 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.078228 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 223/447] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:19.084038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.130392 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.156118 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c96f3-1d1a-4616-95fc-8729779ff51f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.194489 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.195406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.195682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.195962 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.196639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.196940 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.198394 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.200082 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8191a20-4e1e-4682-a373-acb19f3717cc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.207622 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 225/448] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.214513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.246405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.246955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.247226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.247491 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] PATH_INFO: `/v3/projects/d27b46208a754c5cac9c139d839c088c` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.248638 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] RBAC: Authorizing `identity:get_project(project_id=d27b46208a754c5cac9c139d839c088c)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.250143 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.251722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 224/449] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/projects/d27b46208a754c5cac9c139d839c088c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:19.257550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.305719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.336348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41dc10-eebf-4070-a193-16357c504cb8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.380391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.380391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.380391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.380391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.382954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2e1b1-cd07-4572-b5ce-8e3db3efff1b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.395972 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.426203 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.427534 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.427534 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.427534 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] PATH_INFO: `/v3/groups/a65cccf2a33243708e3b9d418bff31bb` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.428525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] RBAC: Authorizing `identity:get_group(group_id=a65cccf2a33243708e3b9d418bff31bb)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.430491 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.432851 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 225/450] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/groups/a65cccf2a33243708e3b9d418bff31bb => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:19.438507 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.470166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.471668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.561109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e2c9c-ba17-4965-aef0-6021ad5ae4c9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.565204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.595357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 226/451] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 16:03:19.600901 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.601669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.602278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.602555 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.602822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.603545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] RBAC: Adding query filter params (group.id=a65cccf2a33243708e3b9d418bff31bb, role.id=c30a3e1df1b74cd186fed662062d8e9d, scope.project.id=d27b46208a754c5cac9c139d839c088c) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:19.603847 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.605616 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.611425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 226/452] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/role_assignments?group.id=a65cccf2a33243708e3b9d418bff31bb&scope.project.id=d27b46208a754c5cac9c139d839c088c&role.id=c30a3e1df1b74cd186fed662062d8e9d => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.649978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:19.710951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52091e83-9287-40d5-ba89-472fc0c4e6b4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.746934 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.747587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.747822 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.748085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] PATH_INFO: `/v3/projects/35b16f4dab55413091c1b8347836e133` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.749211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] RBAC: Authorizing `identity:get_project(project_id=35b16f4dab55413091c1b8347836e133)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.750671 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.752472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 227/453] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/projects/35b16f4dab55413091c1b8347836e133 => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:19.757980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:19.863886 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6304fc-c75c-4231-874d-da9175ecc34b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:19.899633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc137585-cd71-426f-af80-4e12f823c41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:19.900523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc137585-cd71-426f-af80-4e12f823c41d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:19.900799 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc137585-cd71-426f-af80-4e12f823c41d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:19.901112 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc137585-cd71-426f-af80-4e12f823c41d None admin] PATH_INFO: `/v3/groups/326bb5697c654601bb14cbea6c69df5b` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:19.902450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc137585-cd71-426f-af80-4e12f823c41d None admin] RBAC: Authorizing `identity:get_group(group_id=326bb5697c654601bb14cbea6c69df5b)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:19.903905 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc137585-cd71-426f-af80-4e12f823c41d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:19.905548 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 227/454] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/groups/326bb5697c654601bb14cbea6c69df5b => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:19.911385 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:20.023552 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd03d7b-f323-416a-85ec-d61c1f0faaed None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:20.036033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:20.059490 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a59b48-ce0a-4919-a81d-eced82f55829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:20.060074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a59b48-ce0a-4919-a81d-eced82f55829 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:20.060350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a59b48-ce0a-4919-a81d-eced82f55829 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:20.060616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a59b48-ce0a-4919-a81d-eced82f55829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:20.061351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a59b48-ce0a-4919-a81d-eced82f55829 None admin] RBAC: Adding query filter params (group.id=326bb5697c654601bb14cbea6c69df5b, role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=35b16f4dab55413091c1b8347836e133) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:20.061658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a59b48-ce0a-4919-a81d-eced82f55829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:20.063070 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a59b48-ce0a-4919-a81d-eced82f55829 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:20.068584 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 228/455] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 17 16:03:19 2022] GET /identity/v3/role_assignments?group.id=326bb5697c654601bb14cbea6c69df5b&scope.project.id=35b16f4dab55413091c1b8347836e133&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:22.546256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571c81-f7d4-41c2-9acd-8bd57160c3d2 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.546779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571c81-f7d4-41c2-9acd-8bd57160c3d2 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.546779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24571c81-f7d4-41c2-9acd-8bd57160c3d2 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.548367 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 228/456] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:22.553595 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc61374-4572-431e-845a-72abaa7f75f4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.554437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc61374-4572-431e-845a-72abaa7f75f4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.554903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc61374-4572-431e-845a-72abaa7f75f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.574337 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-fbc61374-4572-431e-845a-72abaa7f75f4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:22.575925 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-fbc61374-4572-431e-845a-72abaa7f75f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:22.648889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 229/457] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:22.758465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f36362-fb61-489d-bfcf-5717a602f6d2 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.759110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f36362-fb61-489d-bfcf-5717a602f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.759586 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f36362-fb61-489d-bfcf-5717a602f6d2 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.761780 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 229/458] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:22.767254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dfb17-a2ee-458a-b42a-b78eeecc236b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.767866 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dfb17-a2ee-458a-b42a-b78eeecc236b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.768352 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dfb17-a2ee-458a-b42a-b78eeecc236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.788837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-f50dfb17-a2ee-458a-b42a-b78eeecc236b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:22.790066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f50dfb17-a2ee-458a-b42a-b78eeecc236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:22.859619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 230/459] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:22.927242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a8804-c8d8-43a2-aad9-68b5bad0642a None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.927747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a8804-c8d8-43a2-aad9-68b5bad0642a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.928449 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a8804-c8d8-43a2-aad9-68b5bad0642a None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.930205 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 230/460] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:22.936303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4cac7-3492-40d2-bf80-a35ba3fe4b18 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:22.936745 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4cac7-3492-40d2-bf80-a35ba3fe4b18 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:22.937156 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4cac7-3492-40d2-bf80-a35ba3fe4b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:22.956544 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-82a4cac7-3492-40d2-bf80-a35ba3fe4b18 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:22.957989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-82a4cac7-3492-40d2-bf80-a35ba3fe4b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:22.995825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a8804-c8d8-43a2-aad9-68b5bad0642a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.000821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.036255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.057484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 231/461] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:23.116211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a8804-c8d8-43a2-aad9-68b5bad0642a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.153841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.154522 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.154804 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.155071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.166326 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.168637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:23.184639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:23.185574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:23.186907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:23.186907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.186907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:23.186907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 231/462] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:23.192117 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4cac7-3492-40d2-bf80-a35ba3fe4b18 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.217983 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.305222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4cac7-3492-40d2-bf80-a35ba3fe4b18 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.321793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.336531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77d440-78c3-4dd7-9098-7afa251d7812 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.345226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e45c7f-0cdb-4976-8a6a-377db984a97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.345991 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45c7f-0cdb-4976-8a6a-377db984a97f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.346487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45c7f-0cdb-4976-8a6a-377db984a97f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.346954 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e45c7f-0cdb-4976-8a6a-377db984a97f None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.347783 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e45c7f-0cdb-4976-8a6a-377db984a97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:23.348278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e45c7f-0cdb-4976-8a6a-377db984a97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.349966 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e45c7f-0cdb-4976-8a6a-377db984a97f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.366465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 232/463] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:23.367969 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c11b8-d350-412e-ad10-975df03b8c9d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.368466 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c11b8-d350-412e-ad10-975df03b8c9d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.368883 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c11b8-d350-412e-ad10-975df03b8c9d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.370441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 233/464] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:23.371296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c11b8-d350-412e-ad10-975df03b8c9d None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.378084 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8c92d-c126-4568-8d03-0f6a8196a71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.378726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8c92d-c126-4568-8d03-0f6a8196a71c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.379019 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8c92d-c126-4568-8d03-0f6a8196a71c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.379269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8c92d-c126-4568-8d03-0f6a8196a71c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.392301 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8c92d-c126-4568-8d03-0f6a8196a71c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.393917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8c92d-c126-4568-8d03-0f6a8196a71c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.400945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8ad8c92d-c126-4568-8d03-0f6a8196a71c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:23.409735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:23.410630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:23.411947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:23.411947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.411947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:23.411947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 232/465] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:23.411947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4f2d-96d6-4719-9de0-ebfbfcabb46f None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.412210 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4f2d-96d6-4719-9de0-ebfbfcabb46f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.412455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb4f2d-96d6-4719-9de0-ebfbfcabb46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.429600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a2fb4f2d-96d6-4719-9de0-ebfbfcabb46f None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:23.430790 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a2fb4f2d-96d6-4719-9de0-ebfbfcabb46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:23.483630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c11b8-d350-412e-ad10-975df03b8c9d None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.498400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 233/466] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:23.499241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb4f2d-96d6-4719-9de0-ebfbfcabb46f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.518627 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.519223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.519499 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.519768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.520443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.521897 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.550938 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 234/467] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:03:23 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:23.551762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.612123 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.658881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.659929 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb4f2d-96d6-4719-9de0-ebfbfcabb46f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.686347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad19212-eb9b-43c0-8a67-b9880d2ece85 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.709405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.710357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.710811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.711784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.727227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.728453 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.729173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.730119 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.730241 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.730568 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.731296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:23.731670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.733304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.747568 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 235/468] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:23.750622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:23.751474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:23.752314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:23.752314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:23.752314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:23.753057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.754797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 234/469] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:23.761811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.878630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57794bd-11af-4931-8bc1-09f20b731e7d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.886776 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e5e2f-8d87-4a85-9466-e1ad3ebb5a56 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:23.909752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.919028 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.919632 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.919982 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.920175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.920805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.922252 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.922850 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:23.923452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:23.923728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:23.923995 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:23.924636 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:23.924937 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:23.926327 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:23.934053 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:23.945277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 235/470] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:23.945972 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:23.953398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 236/471] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:03:23 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:23.953398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.091428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1d097-f179-4c5f-a8de-3511eb48ded0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.124445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81721d7f-7d55-41e6-9845-4d105e069164 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.133390 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.134344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.134811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.135315 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.136612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.138390 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.164856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 237/472] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:03:23 2022] POST /identity/v3/users => generated 248 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:24.170967 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.171619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.171896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.172169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.185721 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.187246 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:24.205882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:24.206855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:24.207674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:24.207674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:24.207674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:24.207674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 236/473] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:24.214609 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.277691 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.334582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beede2-bb79-4829-bd9f-1f82656fe77a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.372239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076a9e-ac6b-4c91-bccd-d596b7c4ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.372807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076a9e-ac6b-4c91-bccd-d596b7c4ba84 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.373086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076a9e-ac6b-4c91-bccd-d596b7c4ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.373390 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076a9e-ac6b-4c91-bccd-d596b7c4ba84 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.374034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076a9e-ac6b-4c91-bccd-d596b7c4ba84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:24.374337 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076a9e-ac6b-4c91-bccd-d596b7c4ba84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.375706 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076a9e-ac6b-4c91-bccd-d596b7c4ba84 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.389701 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 238/474] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:24.395495 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:24.439725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:24.519146 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec40263-85e9-46d8-a490-510e047d5b02 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:24.558342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580848e-4e9e-4deb-800b-a36a7589d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:24.558943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580848e-4e9e-4deb-800b-a36a7589d848 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:24.559220 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580848e-4e9e-4deb-800b-a36a7589d848 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:24.559488 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580848e-4e9e-4deb-800b-a36a7589d848 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:24.560125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580848e-4e9e-4deb-800b-a36a7589d848 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:24.561586 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580848e-4e9e-4deb-800b-a36a7589d848 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:24.584198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 237/475] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:03:24 2022] POST /identity/v3/users => generated 249 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:25.909503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549cf8-4654-4c01-9d98-46d2bf1a5168 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.910051 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549cf8-4654-4c01-9d98-46d2bf1a5168 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.910051 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc549cf8-4654-4c01-9d98-46d2bf1a5168 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.911600 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 239/476] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:25.917103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7102-e023-4bd3-84d6-63e702d0c706 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:25.918003 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7102-e023-4bd3-84d6-63e702d0c706 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:25.918479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e7102-e023-4bd3-84d6-63e702d0c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:25.937972 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-3f2e7102-e023-4bd3-84d6-63e702d0c706 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:25.939516 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3f2e7102-e023-4bd3-84d6-63e702d0c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:26.020172 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 238/477] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:26.355594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc549cf8-4654-4c01-9d98-46d2bf1a5168 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.381361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596fb0-6e08-4e4d-ac82-8f39adc931af None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.381705 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596fb0-6e08-4e4d-ac82-8f39adc931af None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.381945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74596fb0-6e08-4e4d-ac82-8f39adc931af None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.383750 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 239/478] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:26.389568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2171b4-8470-4baf-ad8f-3bcc479d68dd None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.390084 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2171b4-8470-4baf-ad8f-3bcc479d68dd None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.390570 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2171b4-8470-4baf-ad8f-3bcc479d68dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.409351 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7a2171b4-8470-4baf-ad8f-3bcc479d68dd None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:26.410887 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7a2171b4-8470-4baf-ad8f-3bcc479d68dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:26.426954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.469379 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc549cf8-4654-4c01-9d98-46d2bf1a5168 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.485692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.490125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 240/479] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:26.499840 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9bb1-c3df-4217-8010-8b86f5962008 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.500420 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9bb1-c3df-4217-8010-8b86f5962008 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.500831 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9bb1-c3df-4217-8010-8b86f5962008 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.506194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 241/480] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:26.507752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b863-e206-4b27-828b-4189e1639e18 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.508172 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b863-e206-4b27-828b-4189e1639e18 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.508583 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9b863-e206-4b27-828b-4189e1639e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.513110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.513895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.514270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.514641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.528061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:26.529975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ead9b863-e206-4b27-828b-4189e1639e18 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:26.531323 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ead9b863-e206-4b27-828b-4189e1639e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:26.533255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:26.534127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:26.535223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 240/481] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:26.540425 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.610857 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 242/482] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:26.657636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7beaf-4f01-4558-a521-fc68e49aba42 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.693519 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.694113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.694386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.694649 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.695292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:26.695587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.696936 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.706159 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 241/483] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:26.711676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b863-e206-4b27-828b-4189e1639e18 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.801786 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.827975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9b863-e206-4b27-828b-4189e1639e18 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:26.844848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.866559 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:26.867106 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:26.867377 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:26.867641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:26.878921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:26.880391 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:26.888443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:26.897463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:26.898389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:26.899284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:26.899284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:26.899284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:26.899284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 243/484] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:26.904647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:26.965251 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e34b4-7266-4a20-adda-68a18aa76ea0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.008956 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be7fd6-bd47-44bd-8f3e-393adb19f69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.009615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be7fd6-bd47-44bd-8f3e-393adb19f69d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.009889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be7fd6-bd47-44bd-8f3e-393adb19f69d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.010160 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be7fd6-bd47-44bd-8f3e-393adb19f69d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.018064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08ade2-ee3e-4611-ba1c-5480e344869a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.020043 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be7fd6-bd47-44bd-8f3e-393adb19f69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-09be7fd6-bd47-44bd-8f3e-393adb19f69d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:27.024717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:27.026092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 242/485] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:27.032232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614aba8-e90c-4ba9-9b4a-d9be8997039b None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.033112 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614aba8-e90c-4ba9-9b4a-d9be8997039b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.033112 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614aba8-e90c-4ba9-9b4a-d9be8997039b None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.033112 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 243/486] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:27.033112 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614aba8-e90c-4ba9-9b4a-d9be8997039b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.055706 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.061875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.062472 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.062747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.063012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.063641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.063934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.065287 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.077162 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 244/487] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.077982 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.129086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.136881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614aba8-e90c-4ba9-9b4a-d9be8997039b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.170621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c363c-a959-41ea-a51d-71f618c20ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.171237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c363c-a959-41ea-a51d-71f618c20ff8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.171516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c363c-a959-41ea-a51d-71f618c20ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.171783 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c363c-a959-41ea-a51d-71f618c20ff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.177838 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52238e-367b-4e51-956f-902ec856af4e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.181835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c363c-a959-41ea-a51d-71f618c20ff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-069c363c-a959-41ea-a51d-71f618c20ff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:27.187123 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:27.188034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:27.188846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 244/488] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:27.189563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc753b-020e-43a4-9ca5-f66d5aa9e332 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.189628 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc753b-020e-43a4-9ca5-f66d5aa9e332 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.190106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc753b-020e-43a4-9ca5-f66d5aa9e332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.207026 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-0ddc753b-020e-43a4-9ca5-f66d5aa9e332 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:27.208253 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-0ddc753b-020e-43a4-9ca5-f66d5aa9e332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:27.213887 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.214482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.214751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.215013 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.215664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.215957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.217298 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.225011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 245/489] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.225828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.274726 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 245/490] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:27.275822 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc753b-020e-43a4-9ca5-f66d5aa9e332 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.283224 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.332890 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a734c8-1e28-4d5e-a752-240b3710e793 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.364479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.369124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.369804 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.370088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.370357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.379770 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.381412 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.383127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc753b-020e-43a4-9ca5-f66d5aa9e332 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:27.396329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:27.397262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:27.398167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 246/491] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:27.398753 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.426603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.427204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.427486 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.427754 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.428402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.428699 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.430086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.438998 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 246/492] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.439850 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.505675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb31e8-ed99-4ebc-8c15-47fe6e856945 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.521448 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.545002 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.545662 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.545936 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.546204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.557678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.559283 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.560694 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f243875-452f-4168-8c7a-f6339441d822 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:27.574423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:27.575424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:27.576273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:27.576273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:27.576273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:27.582705 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 247/493] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:27.583433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.601204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.603217 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.603498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.603765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.604514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.604901 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.607470 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.644536 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 247/494] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.645270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.649114 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.694581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4cf0e-52c1-4c83-ab01-5ebcc1624f63 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.728160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.728787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.729598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.729865 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.742078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.744381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.746685 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee26aec-71bc-4818-9cd8-e68e4dbb094d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:27.760128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:27.761295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:27.762193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:27.762193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:27.762193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:27.762193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 248/495] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:27.762193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.781944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.782563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.783162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.783437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.783712 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.784353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:27.784654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:27.786116 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:27.797928 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 248/496] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:27.798716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.862032 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:27.869472 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec04db-1c67-4368-9021-d520149bef71 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.901595 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644985-a877-4ca6-8706-30898d2357ac None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:27.903965 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.904581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.904857 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.905128 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:27.915164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:27.920332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:27.921390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 249/497] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:27.922218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:27.937821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:27.938425 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:27.938697 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:27.938985 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.008718 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.014848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.016324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.033399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37650275-491b-4583-8fec-192f1b4e30b1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.067796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.068391 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.068666 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.068938 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.069608 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:28.069911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.071347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.080546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.083640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 250/498] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:28.084446 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.120180 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 249/499] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:28.121011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.184840 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df546471-a881-4fcc-9c42-b627dcfadfd3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.218200 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.218807 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.219074 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.219336 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.221161 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35e2e1-2ef9-46c1-9961-8710ada28e54 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.226271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.227689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.230031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:28.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:28.241892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:28.242828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:28.246760 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 251/500] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:28.247490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.258440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.259398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.259675 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.259965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.261031 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:28.261378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.262745 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.270738 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 250/501] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:28.271508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.299259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.353795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82edbb-d6e7-4d6a-bd51-e2c9d3b625d5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.372790 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e6004-6c5d-4cc4-9a5a-4263539a9f6f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.388265 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.388888 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.389161 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.389477 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.397097 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.398591 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.409189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.409832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.410109 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.410375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:28.411230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:28.412103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:28.412985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 252/502] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:28.413898 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.422121 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.423615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:28.440630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:28.441576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:28.442416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:28.442416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:28.442416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:28.442416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 251/503] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:28.442634 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.477246 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.521468 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580dee78-d767-43c6-b3f8-1e2f83e91915 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.523398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.547164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38c91f-5b8f-4b98-a3ab-682873510797 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.556999 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.558238 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.558514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.558792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.559513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:28.559819 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.561256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.581734 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.582349 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.582621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.582891 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.594159 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.595590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.596750 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 253/504] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:28.597353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:28.614374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:28.615485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:28.616526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:28.616526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:28.616526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:28.616526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 252/505] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:28.616526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.700479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3466d-6563-457b-966f-d53b70128971 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.716031 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c08385-22cb-4048-b555-89ec2bd13868 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.717207 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.738091 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.738697 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.738984 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.739261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.739979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:28.740284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.741760 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.743972 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.750231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.750824 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.751102 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.751372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.752002 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:28.752306 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.753674 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.759493 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 254/506] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:28.760862 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.765782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 253/507] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:28.766590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.865308 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d77ed-03ad-4881-b43b-5b05359258fe None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.865680 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20977d5b-815b-4429-8065-15d996b414e5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:28.898132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.898337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:28.898730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.898864 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:28.899008 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.899139 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:28.899277 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.899407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:28.899911 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:28.900211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.902411 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:28.914275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 254/508] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:28.915094 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:28.944020 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.965416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:28.969633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:28.971124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.019132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd7ee5-bbdd-45c0-950b-dcc03946bc53 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.052856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.053485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.053767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.054039 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.070811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 255/509] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:29.071728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.126114 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.127640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.144915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.171490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d58ee-dc99-4b0e-9ad6-2e3432f758d9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.177422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.205379 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.205998 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.206273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.206539 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.213148 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.214809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:29.226306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:29.228087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:29.228495 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 255/510] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:29.228495 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.232195 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 256/511] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.233088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.330990 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a059-f885-427c-a6e9-2d82962ccaf5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.334297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a83a89-45a2-413b-a82d-03ba8fd124ca None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.364712 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.365350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.365621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.365884 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.367788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.368402 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.368679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.368942 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.371896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.373516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.374977 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.381540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.383005 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:29.389375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.390517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 256/512] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.391585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:29.400046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.401451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:29.402801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:29.402801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.402801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:29.402801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 257/513] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.402801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.407231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.494465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cfe932-fd1f-4303-950f-e954f6407b12 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.504324 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cd76d-9fb2-452f-be36-8086e0466c40 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.530233 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.530846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.531118 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.531384 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.540175 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.540771 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.541050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.541335 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.542304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.542833 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.543141 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.543945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.544623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:29.557832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:29.558704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:29.559798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:29.559798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:29.559798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:29.559798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 257/514] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:29.560435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.567753 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 258/515] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.567753 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.612305 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.622733 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.663424 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b3397-35b6-4f58-baa8-4cc3088ca24d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.665849 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f8ce6-7398-45c7-b90a-1e13581b9339 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.696560 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.697152 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.697463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.697742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.699092 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.699393 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.699485 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.700048 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.700323 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.700588 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.700805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.701212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.701537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.702898 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.713802 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 259/516] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.714593 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.721855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 258/517] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.722497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.813028 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199474d-8916-41d1-9403-ac02d476eec2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.819860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.821281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280208af-a61d-430a-b404-2ed68bc8d2aa None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.842445 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:29.847404 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.848007 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.848282 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.848553 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.849180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.849507 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.850905 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.857744 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:29.858346 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:29.858624 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:29.858912 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:29.859608 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=ae7640a3956e449ebeb41f45eb56aeda) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:29.860348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:29.861312 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:29.862974 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 260/518] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.863762 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.867189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 259/519] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/role_assignments?user.id=ae7640a3956e449ebeb41f45eb56aeda&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:29.868156 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:29.987311 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525da31-cea9-4448-9fef-bef2af672511 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:29.998409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42044c5f-8449-43e5-90d9-4784594fc0a3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.025755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.027132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.027614 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.027898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.039567 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.040311 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.040589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.040856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.048074 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.050087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:30.062088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.062955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:30.063837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 261/520] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.064294 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.096550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.099658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.116317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.117720 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.178317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53f551-5e67-4ace-a9b8-8c30228fe613 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.214607 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.215226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.215948 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.216221 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.225855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.227539 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.228464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 260/521] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:30.229478 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:30.244476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.245460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:30.246317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 262/522] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.246774 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.340674 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.343855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.361641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88c14b2-d4b8-4e1b-8a0b-3cb2a626fd85 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.361815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d5dff-c653-4aae-b29d-0e55ddf70283 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.399055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.399257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.399654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.399755 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.399926 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.400017 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.400190 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.400280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.401706 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.402004 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.403427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.412273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.413792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.426566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 261/523] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.427436 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:30.429876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.430728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:30.431735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:30.431735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:30.431735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:30.431735 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 263/524] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:30.433229 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.534789 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870d8d6-fa53-4cf5-8ac7-b22064aa22f9 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.545522 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c9bb1-bafd-4a37-9c45-666b322438b8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.570359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.570944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.571215 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.571478 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.572183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=c222aec3576b436b8bfcef46f12751ff) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.572479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.574169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.579340 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 264/525] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/role_assignments?user.id=c222aec3576b436b8bfcef46f12751ff&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.580096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.592702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.593248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.594456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.594999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.595450 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.596381 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.596912 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.598650 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.612562 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 262/526] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.618630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.622923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.727344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889c080-acad-4424-a135-8e0a93797bde None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.738341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033a2a2-fc48-42dd-acf5-4c9f2b31d2ce None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.779386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.780172 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.780542 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.780917 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.781493 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.781903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=738338255eae424ebc3ab73e2cf6b203) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.782334 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.782547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.783046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.783463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.784187 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.784389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:30.784854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.786786 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.797497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 263/527] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/role_assignments?user.id=738338255eae424ebc3ab73e2cf6b203&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.803320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 265/528] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:30.809931 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:30.887591 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:30.927512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d6784d-f042-4047-8d12-491d28f611bb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:30.966573 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:30.967223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:30.967494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:30.967759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:30.976082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:30.977610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:30.994656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:30.996035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:30.996898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 264/529] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:31.002490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.069635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.110276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47095e8-a5dd-40ed-a77a-10b2d1af0f5b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.146498 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537410e8-790b-4ec8-ba85-79ff64059088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.147019 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537410e8-790b-4ec8-ba85-79ff64059088 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.147294 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537410e8-790b-4ec8-ba85-79ff64059088 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.147561 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537410e8-790b-4ec8-ba85-79ff64059088 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.148247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537410e8-790b-4ec8-ba85-79ff64059088 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:31.148545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537410e8-790b-4ec8-ba85-79ff64059088 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.150004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537410e8-790b-4ec8-ba85-79ff64059088 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.167734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 266/530] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:31.170281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:31.275069 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3363610-2b0b-4ee2-b0d1-07a323be93b5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:31.303397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:31.312113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d454cf-0071-41af-a8bd-2cea6b90fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:31.312817 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d454cf-0071-41af-a8bd-2cea6b90fb53 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:31.313096 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d454cf-0071-41af-a8bd-2cea6b90fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:31.313382 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d454cf-0071-41af-a8bd-2cea6b90fb53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:31.314104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d454cf-0071-41af-a8bd-2cea6b90fb53 None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=30a70853ec1d420b9533cf1d056e170b) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:31.314460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d454cf-0071-41af-a8bd-2cea6b90fb53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:31.315948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d454cf-0071-41af-a8bd-2cea6b90fb53 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:31.325459 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 265/531] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:31 2022] GET /identity/v3/role_assignments?user.id=30a70853ec1d420b9533cf1d056e170b&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.107625 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdc84-13bb-4e62-81d0-46f4130c895a None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.107899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdc84-13bb-4e62-81d0-46f4130c895a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.108168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879fdc84-13bb-4e62-81d0-46f4130c895a None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.109775 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 267/532] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:32.115637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae90f3d-545e-41b8-bec7-f4dc1dbe463f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.115927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae90f3d-545e-41b8-bec7-f4dc1dbe463f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.116203 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae90f3d-545e-41b8-bec7-f4dc1dbe463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.140897 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-aae90f3d-545e-41b8-bec7-f4dc1dbe463f None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:32.142592 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-aae90f3d-545e-41b8-bec7-f4dc1dbe463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:32.222110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 266/533] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:32.572830 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fdc84-13bb-4e62-81d0-46f4130c895a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.691642 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879fdc84-13bb-4e62-81d0-46f4130c895a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.715923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.727781 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.728419 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.728693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.729582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.740388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:32.745102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:32.746108 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:32.746913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 268/534] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:32.752474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae90f3d-545e-41b8-bec7-f4dc1dbe463f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:32.869163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae90f3d-545e-41b8-bec7-f4dc1dbe463f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:32.897715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:32.910060 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13291ce-c076-483c-85ce-b776d2441915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:32.910726 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13291ce-c076-483c-85ce-b776d2441915 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:32.911000 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13291ce-c076-483c-85ce-b776d2441915 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:32.911269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13291ce-c076-483c-85ce-b776d2441915 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:32.911955 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13291ce-c076-483c-85ce-b776d2441915 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:32.912257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13291ce-c076-483c-85ce-b776d2441915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:32.913830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13291ce-c076-483c-85ce-b776d2441915 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:32.925469 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 267/535] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:32.934542 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.047213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd40f96-4dc9-4b9e-ae34-5a942e79db32 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.083059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.083769 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.084050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.084310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.087190 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03e52-754f-4690-bd88-a384f105e563 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.087462 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03e52-754f-4690-bd88-a384f105e563 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.087725 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a03e52-754f-4690-bd88-a384f105e563 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.090532 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 268/536] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:33.097615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5b38-2b21-4f5d-a866-cc5606d5d5a2 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.098113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5b38-2b21-4f5d-a866-cc5606d5d5a2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.098608 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5b38-2b21-4f5d-a866-cc5606d5d5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.100490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:33.103205 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:33.123337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:33.124267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:33.125110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:33.125110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:33.125110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:33.126838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-daaa5b38-2b21-4f5d-a866-cc5606d5d5a2 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:33.127263 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 269/537] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:33.132313 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-daaa5b38-2b21-4f5d-a866-cc5606d5d5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:33.134815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.185549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:33.212848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 269/538] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:33.268662 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84370b13-4ab5-4e64-bdaf-469ce14176d8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.295173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8739-9fa8-4fae-ae12-de21fba2de10 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.295693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8739-9fa8-4fae-ae12-de21fba2de10 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.295693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef8739-9fa8-4fae-ae12-de21fba2de10 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.297300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 270/539] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:33.302578 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e1db-0765-464c-8da3-78c574189c6f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.302852 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e1db-0765-464c-8da3-78c574189c6f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.303119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9e1db-0765-464c-8da3-78c574189c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.307858 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.308869 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.309307 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.309748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.310971 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:33.311320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:33.312601 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:33.322932 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-69b9e1db-0765-464c-8da3-78c574189c6f None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:33.325224 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-69b9e1db-0765-464c-8da3-78c574189c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:33.325970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 270/540] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:33.331491 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.425426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 271/541] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:33.447325 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:33.455393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9598f-6bcf-4a40-97b7-8db5a229d39d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.492646 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.493649 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.493932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.494205 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.502793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:33.504306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:33.517056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:33.518011 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:33.518875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 271/542] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:33.526285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e1db-0765-464c-8da3-78c574189c6f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.581619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:33.596122 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.657940 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9e1db-0765-464c-8da3-78c574189c6f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.697621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad5e37-1282-49a6-ad35-9682ef17b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.699052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad5e37-1282-49a6-ad35-9682ef17b1d5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.699930 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad5e37-1282-49a6-ad35-9682ef17b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.700198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad5e37-1282-49a6-ad35-9682ef17b1d5 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.700921 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad5e37-1282-49a6-ad35-9682ef17b1d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:33.701222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad5e37-1282-49a6-ad35-9682ef17b1d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:33.703372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad5e37-1282-49a6-ad35-9682ef17b1d5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:33.726086 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9363e-f964-4ce0-b3f4-5262b8b6976c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.726516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 272/543] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:33.727765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440597-013c-4b6e-9840-42edcbf5e68a None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.728045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440597-013c-4b6e-9840-42edcbf5e68a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.728311 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19440597-013c-4b6e-9840-42edcbf5e68a None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.733461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 273/544] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:33.733461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19440597-013c-4b6e-9840-42edcbf5e68a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.771498 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b391075-fbd5-40da-8441-c622486044ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.772117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391075-fbd5-40da-8441-c622486044ca None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.772392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391075-fbd5-40da-8441-c622486044ca None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.772656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b391075-fbd5-40da-8441-c622486044ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.784774 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b391075-fbd5-40da-8441-c622486044ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2b391075-fbd5-40da-8441-c622486044ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:33.789894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:33.790823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:33.792481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 272/545] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:33.793397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69442df-83f8-4ca0-a022-8247a9fdea27 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.793397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69442df-83f8-4ca0-a022-8247a9fdea27 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.793732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69442df-83f8-4ca0-a022-8247a9fdea27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.812399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c69442df-83f8-4ca0-a022-8247a9fdea27 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:33.813770 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c69442df-83f8-4ca0-a022-8247a9fdea27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:33.823257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:33.845466 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19440597-013c-4b6e-9840-42edcbf5e68a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:33.848056 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:33.881364 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 273/546] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:33.881728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:33.882354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:33.882568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69442df-83f8-4ca0-a022-8247a9fdea27 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.882659 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:33.882885 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:33.901567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:33.903148 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:33.918737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:33.919673 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:33.920510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:33.920510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:33.920510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:33.920510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 274/547] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:33.920721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:33.995459 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69442df-83f8-4ca0-a022-8247a9fdea27 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.033814 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.034258 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d213ff-7c79-4358-8094-65fe162f8b16 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.034600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.034948 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.035288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.046730 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:34.051893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.052939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:34.053868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:34.054486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 274/548] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:34.054786 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.059409 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.078683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.079290 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.079570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.079842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.080509 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.080812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.082459 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.092353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 275/549] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.097486 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.116371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.176050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e220bf1-c4f6-4eef-a48f-fbde8c2ca10c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.205795 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa5a1d-79da-4658-8081-2782e79d049f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.215309 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.216291 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.216570 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.216845 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.217519 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.217828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.219198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.235741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 275/550] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.235741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.247188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.247725 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.248004 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.248272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.248930 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.249229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.250726 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.258725 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 276/551] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.259662 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.298295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.336767 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f66e31-7a6e-4abc-9b49-47c0d473d680 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.342376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.363811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fc201-4b75-43ac-8b17-e9091976886c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.372251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.372870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.373145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.373460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.383853 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.386368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.397940 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.398543 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.398813 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.399077 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:34.400090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.401455 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:34.403344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:34.403344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:34.403344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:34.403344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 276/552] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:34.403344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.410954 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.412419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:34.424849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.425927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 277/553] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:34.426894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.507582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e0a63-e002-45a1-8f80-60b815080aef None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.523623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.527249 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914fc86-8c60-40c5-8af4-cbb669a925fc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.542433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.543051 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.543323 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.543587 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.553549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:34.560664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.561809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:34.562622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 277/554] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:34.563291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.563291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.563430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.563508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.563508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.571254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.575789 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.577249 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:34.591574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:34.592511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:34.593548 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:34.593548 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:34.593548 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:34.593548 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 278/555] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:34.593548 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.665483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc61a7-4481-4acc-ba7d-3c203dd6bb3f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.691435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094be472-b5ae-4128-ad8d-10c688051742 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.699558 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.700155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.700430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.700700 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.701361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.701654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.703008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.714552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 278/556] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.715332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.726604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.727207 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.727485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.727759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.728440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.728741 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.731042 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.742917 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 279/557] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.743704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.750176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.795503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.817206 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6cee5f-c532-42af-a3ca-7bb36444dafc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.846881 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb65b3-f9fb-4dd4-bc85-9a3c47a0a6d6 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:34.851686 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.852282 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.852556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.852824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.853505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.853806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.855587 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.863890 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 279/558] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.864688 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.886326 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:34.887038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:34.887314 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:34.887581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:34.888204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:34.888499 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:34.889878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:34.901190 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 280/559] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:34.902173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:34.961441 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:34.966725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4199b-e5d5-475e-bd7f-616b97f4efcc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.003603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.004228 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.004721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e11ec5-ee56-419f-88f8-4e918421b8b1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.004894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.004894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] PATH_INFO: `/v3/users/glance` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.012447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.013923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.015719 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:35.029854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.031117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 280/560] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:35.032116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.049722 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.050298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.050604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.050874 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] PATH_INFO: `/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/ae7640a3956e449ebeb41f45eb56aeda/roles/053c9fe4ac034c11970b0bce8179187c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.065640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3887437d064297aba3a0bf12f93d78, user_id=ae7640a3956e449ebeb41f45eb56aeda, role_id=053c9fe4ac034c11970b0bce8179187c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.067109 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.079960 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 281/561] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:34 2022] PUT /identity/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/ae7640a3956e449ebeb41f45eb56aeda/roles/053c9fe4ac034c11970b0bce8179187c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:35.093624 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.143799 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdcfce-2303-4b32-92ba-73fedf68952f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.184661 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.185292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.186599 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.186599 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.196372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59cfffe-e3d2-410e-baaa-2ed913de2c1f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.199165 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.200675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:35.216766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.218018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:35.219068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:35.219068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.219068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:35.224686 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 281/562] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:35.224686 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.237034 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.246327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.246967 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.247241 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.247507 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.255429 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.257256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:35.272576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.273655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:35.274620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 282/563] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:35.275210 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.298011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.345561 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d065d2-0941-49b6-a03d-846d6e511d8d None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.383947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.384642 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.384986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.385374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.385729 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61ac46-ed09-4f7f-8802-7dab7e5a4af1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.386289 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:35.386528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.388039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.406041 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 282/564] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:35.407058 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.425718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.426412 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.426694 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.426965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.427606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:35.427908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.429268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.442156 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 283/565] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:35.442991 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.487722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.527956 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.530017 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6280d-051a-4d03-826a-21377ae60098 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.547666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b5c60-020d-41e6-bba4-dbf253333304 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.567352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.567950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.568221 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.568483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.569200 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:35.569517 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.571054 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.585364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.585364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.585754 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.586085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.596999 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 283/566] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:35.596999 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.601686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.603202 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:35.618580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.620732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:35.622463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:35.622463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.622463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:35.622463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 284/567] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:35.622463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.702685 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662cf50c-d5a4-4a4c-9d1e-15182b5be66a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.730926 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.737777 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47cbb1-3b9e-4d3e-8791-92482285cd4c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.740645 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.741277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.741596 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.741864 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.749344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.750810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:35.763902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.764841 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 284/568] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:35.765783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.774479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:35.782290 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.782913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.783190 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.783456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.800087 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.802361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:35.820110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:35.821248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:35.827257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:35.827257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:35.827257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:35.827257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 285/569] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:35.827257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.886691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac4d35-1fbc-486d-a72b-0aa8c9baa7dd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.923347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.923942 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.924223 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.924496 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.925125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:35.925447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.926829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.933775 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f789078-1375-4846-a797-ffcee0da4122 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:35.938694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 285/570] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:35.939639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:35.974234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:35.974931 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:35.975296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:35.975547 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:35.976346 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:35.976652 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:35.978154 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:35.994388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.002240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 286/571] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.002893 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.053549 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.055257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc764215-6981-4864-bad8-dd2a84b28de0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.093559 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885501b-393e-4442-8104-685b93aec316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.094192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885501b-393e-4442-8104-685b93aec316 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.094557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885501b-393e-4442-8104-685b93aec316 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.095095 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885501b-393e-4442-8104-685b93aec316 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.095581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885501b-393e-4442-8104-685b93aec316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.095945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885501b-393e-4442-8104-685b93aec316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.097503 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885501b-393e-4442-8104-685b93aec316 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.111745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 286/572] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.113600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885501b-393e-4442-8104-685b93aec316 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.123350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355157c-097c-4557-b801-19fdb5e7ab1d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.159410 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.159948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.160217 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.160485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.168076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.169526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:36.181616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:36.183640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 287/573] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:36.184531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.231920 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885501b-393e-4442-8104-685b93aec316 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.240773 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.270546 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.271169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.271444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.271710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.283401 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.284911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:36.299901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:36.300860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:36.302440 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:36.302440 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:36.302440 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:36.302620 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3330194f-611c-432a-92ec-bf42c5790031 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.303230 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.305782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 287/574] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:36.306521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.338978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.339821 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.340096 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.340361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.347086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.348544 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:36.360908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:36.361935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 288/575] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:36.362849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.439922 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543816-2f60-41b7-a611-30bae5412fea None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.470064 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fca9e0-56f1-4a9d-a322-595970fd7f0e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.474477 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.475073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.475346 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.475608 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.476280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.476578 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.478145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.491627 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 288/576] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.492414 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.510402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.511040 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.511315 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.511537 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.512166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.512465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.513854 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.513983 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.532206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 289/577] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.532206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.554555 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.609670 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d266e-981c-4e95-8321-0df9c1f0e615 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.634541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca54c7d-caab-4485-b106-b68f2fd8fcec None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.647824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.648767 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.649194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.649657 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.651286 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:36.651984 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.653702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.666272 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 289/578] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:36.667644 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.676534 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.677196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.677514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.677783 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] PATH_INFO: `/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/c222aec3576b436b8bfcef46f12751ff/roles/053c9fe4ac034c11970b0bce8179187c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.692875 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3887437d064297aba3a0bf12f93d78, user_id=c222aec3576b436b8bfcef46f12751ff, role_id=053c9fe4ac034c11970b0bce8179187c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.694331 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.721366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 290/579] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:36 2022] PUT /identity/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/c222aec3576b436b8bfcef46f12751ff/roles/053c9fe4ac034c11970b0bce8179187c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:36.721366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.757345 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.788917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c804b79-25a3-428b-9757-97abacbef421 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.824269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:36.834875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.835520 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.835799 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.836068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.844381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.845904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:36.859763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:36.860713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:36.861709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:36.865897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 290/580] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:36.866871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:36.874518 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9571b-5f03-46b5-89e4-837cf5eb7d70 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:36.927687 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:36.928351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:36.928629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:36.928902 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] PATH_INFO: `/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/738338255eae424ebc3ab73e2cf6b203/roles/053c9fe4ac034c11970b0bce8179187c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:36.945635 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3887437d064297aba3a0bf12f93d78, user_id=738338255eae424ebc3ab73e2cf6b203, role_id=053c9fe4ac034c11970b0bce8179187c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:36.948857 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:36.968502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 291/581] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:36 2022] PUT /identity/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/738338255eae424ebc3ab73e2cf6b203/roles/053c9fe4ac034c11970b0bce8179187c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:37.000684 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4731ecc-75f9-402e-b9cc-0f18d104a123 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.042147 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031d8e-172f-4628-9b62-5c665ffcf8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.042775 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031d8e-172f-4628-9b62-5c665ffcf8be None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.043067 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031d8e-172f-4628-9b62-5c665ffcf8be None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.043318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031d8e-172f-4628-9b62-5c665ffcf8be None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.044034 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031d8e-172f-4628-9b62-5c665ffcf8be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:37.044338 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031d8e-172f-4628-9b62-5c665ffcf8be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:37.045889 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78031d8e-172f-4628-9b62-5c665ffcf8be None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:37.060595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 291/582] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:37.061240 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:37.070436 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:37.196039 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829559-d417-4a51-8862-6544ac46b6f1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.224273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:37.250554 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fc27b-0546-423a-959b-1c30b8c2972b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.251215 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc27b-0546-423a-959b-1c30b8c2972b None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.251489 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc27b-0546-423a-959b-1c30b8c2972b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.251759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fc27b-0546-423a-959b-1c30b8c2972b None admin] PATH_INFO: `/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/30a70853ec1d420b9533cf1d056e170b/roles/053c9fe4ac034c11970b0bce8179187c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.268767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fc27b-0546-423a-959b-1c30b8c2972b None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3887437d064297aba3a0bf12f93d78, user_id=30a70853ec1d420b9533cf1d056e170b, role_id=053c9fe4ac034c11970b0bce8179187c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:37.271525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44fc27b-0546-423a-959b-1c30b8c2972b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:37.286562 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 292/583] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:37 2022] PUT /identity/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/30a70853ec1d420b9533cf1d056e170b/roles/053c9fe4ac034c11970b0bce8179187c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:37.347990 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b52b-4fc3-46e7-aa0b-d7041a3349dd None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.348343 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b52b-4fc3-46e7-aa0b-d7041a3349dd None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.348528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2b52b-4fc3-46e7-aa0b-d7041a3349dd None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.350173 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 292/584] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:37.355988 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e8bc-fedc-49e6-bc64-aab57fcd2422 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.356272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e8bc-fedc-49e6-bc64-aab57fcd2422 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.356532 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9e8bc-fedc-49e6-bc64-aab57fcd2422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.377642 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-47f9e8bc-fedc-49e6-bc64-aab57fcd2422 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:37.379036 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-47f9e8bc-fedc-49e6-bc64-aab57fcd2422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:37.460536 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 293/585] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:37.808715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b52b-4fc3-46e7-aa0b-d7041a3349dd None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:37.917925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2b52b-4fc3-46e7-aa0b-d7041a3349dd None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:37.955641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:37.956262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:37.956532 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:37.956795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:37.967966 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:37.972748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:37.973758 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:37.974590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 293/586] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:37.980557 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9e8bc-fedc-49e6-bc64-aab57fcd2422 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.089506 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9e8bc-fedc-49e6-bc64-aab57fcd2422 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:38.090919 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:38.132628 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:38.133231 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.133534 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.133807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.134461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:38.134793 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.137149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.146144 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 294/587] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:38.152176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.215260 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:38.260306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab76a8f-1f35-4bdd-9232-2b612f002456 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:38.295555 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:38.296191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.296469 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.296916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.311641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.313079 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:38.328426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:38.330610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:38.332784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:38.332784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:38.332784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:38.332784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 294/588] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:38.335467 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.445095 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883dba3-f5b7-48c2-93ee-34e077ec52db None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:38.482202 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:38.482811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.483085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.483357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.484003 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:38.484303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.485746 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.498348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 295/589] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:38.503785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.608182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da0440-b63f-4ebf-9988-d337076b353f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:38.622637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:38.644517 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:38.645148 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.645451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.645715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.655054 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.656786 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:38.668211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:38.670353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:38.672388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 295/590] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:38.674938 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.710204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:38.785909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ddcf06-ac1a-4645-8925-44863674b1f1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:38.821211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84af507-3660-4ed9-91af-5c9ab7ded314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:38.821894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af507-3660-4ed9-91af-5c9ab7ded314 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:38.822179 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af507-3660-4ed9-91af-5c9ab7ded314 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:38.822452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84af507-3660-4ed9-91af-5c9ab7ded314 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:38.823198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af507-3660-4ed9-91af-5c9ab7ded314 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:38.823502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af507-3660-4ed9-91af-5c9ab7ded314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:38.824911 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84af507-3660-4ed9-91af-5c9ab7ded314 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:38.844345 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 296/591] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:38.849773 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:38.965513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ddd74-8a99-40ad-87e2-1f34ad7d5f7e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.001677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.002335 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.002607 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.002873 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.044822 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:39.075956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:39.077471 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d2e1f-1798-4268-a02e-cc1b6684df06 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.077907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:39.077987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d2e1f-1798-4268-a02e-cc1b6684df06 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.077987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d2e1f-1798-4268-a02e-cc1b6684df06 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.080709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 297/592] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:39.084948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989c012-eeea-49bf-bb9a-989b135330fd None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.085226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989c012-eeea-49bf-bb9a-989b135330fd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.085639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989c012-eeea-49bf-bb9a-989b135330fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.104880 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3989c012-eeea-49bf-bb9a-989b135330fd None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:39.106226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3989c012-eeea-49bf-bb9a-989b135330fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:39.189350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 296/593] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:39.197352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.257432 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 298/594] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:39.273123 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:39.372802 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0fc499-5303-4913-948d-feb7e8b17ddf None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.379380 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fff59-f4c4-441a-9912-adee6767ba75 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.379380 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fff59-f4c4-441a-9912-adee6767ba75 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.379380 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fff59-f4c4-441a-9912-adee6767ba75 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.379934 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 299/595] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:39.384996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243ea2-8f7b-470a-a005-26fda86cc9fe None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.385780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243ea2-8f7b-470a-a005-26fda86cc9fe None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.385780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6243ea2-8f7b-470a-a005-26fda86cc9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.404857 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d6243ea2-8f7b-470a-a005-26fda86cc9fe None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:39.406160 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d6243ea2-8f7b-470a-a005-26fda86cc9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:39.414371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:39.430837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.432908 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.433598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.434650 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.457229 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:39.460818 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:39.485404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 300/596] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:39.496528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:39.497577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:39.498482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:39.498482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:39.498482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:39.503717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 297/597] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:39.507373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6243ea2-8f7b-470a-a005-26fda86cc9fe None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.647158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.654463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6243ea2-8f7b-470a-a005-26fda86cc9fe None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.697547 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581a294-c666-46d5-80f5-d27e0c573284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.699012 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581a294-c666-46d5-80f5-d27e0c573284 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.699898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581a294-c666-46d5-80f5-d27e0c573284 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.700351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581a294-c666-46d5-80f5-d27e0c573284 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.701517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581a294-c666-46d5-80f5-d27e0c573284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:39.702000 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581a294-c666-46d5-80f5-d27e0c573284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:39.703864 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581a294-c666-46d5-80f5-d27e0c573284 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:39.729707 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 301/598] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:39.731898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcdf66-7f06-47ad-8a80-345ae5f71872 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.732546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcdf66-7f06-47ad-8a80-345ae5f71872 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.733140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcdf66-7f06-47ad-8a80-345ae5f71872 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.735369 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 302/599] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:39.736232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcdf66-7f06-47ad-8a80-345ae5f71872 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.744761 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:39.774208 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fabf9e-4de2-4b05-9742-4d58237d6ecb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.798471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:39.810715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914bcb5-31be-4b46-b3cb-f9c57bdb8959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.811327 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914bcb5-31be-4b46-b3cb-f9c57bdb8959 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.811600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914bcb5-31be-4b46-b3cb-f9c57bdb8959 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.811869 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914bcb5-31be-4b46-b3cb-f9c57bdb8959 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.821663 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914bcb5-31be-4b46-b3cb-f9c57bdb8959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b914bcb5-31be-4b46-b3cb-f9c57bdb8959 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:39.827408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:39.828371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:39.829219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:39.833445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 298/600] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:39.834385 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73be4b-f057-4b86-8104-1d9f0e22a725 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.834661 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73be4b-f057-4b86-8104-1d9f0e22a725 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.834932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73be4b-f057-4b86-8104-1d9f0e22a725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.854530 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4d73be4b-f057-4b86-8104-1d9f0e22a725 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:39.855781 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4d73be4b-f057-4b86-8104-1d9f0e22a725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:39.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcdf66-7f06-47ad-8a80-345ae5f71872 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:39.894694 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:39.895314 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:39.895594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:39.895861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:39.903426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:39.904785 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:39.915651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:39.921705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 303/601] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:39.922766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.923337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 299/602] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:39.924252 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73be4b-f057-4b86-8104-1d9f0e22a725 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:39.991416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.036068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73be4b-f057-4b86-8104-1d9f0e22a725 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.040390 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f56550-18f3-49aa-a7f4-593710f8b291 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.050465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.073231 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.073868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.074142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.074404 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.076800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.077498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.078028 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.078028 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.078682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.078985 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.080386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.085699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:40.088721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 304/603] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.089693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:40.090457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:40.091350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:40.092198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 300/604] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:40.094149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.198660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd0d6d-e0b4-4681-b79b-f86e4c797b16 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.204625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d135278-5bbc-4d79-995a-d52ce7178963 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.228029 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.236525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.237212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.237607 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.237957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.239768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.240359 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.240634 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.240909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.241619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.241923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.243339 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.249856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.251627 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.255921 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 305/605] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.256818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:40.269701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:40.270808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:40.271912 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:40.271912 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:40.271912 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:40.273467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 301/606] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:40.274436 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.299313 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.360119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad85922-b542-4354-9124-c8a7c95058f3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.375295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d5990-cc6a-45c5-b801-0d6450e189f1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.395785 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.396390 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.396666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.396939 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.397628 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.397929 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.399280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.407402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 306/607] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.408197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.408734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.409545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.409666 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.409916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.420929 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:40.426093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:40.427197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 302/608] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:40.428018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.459122 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.511534 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa67c8-41dc-4ea3-9f4f-f90c0ef24b5f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.513646 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.532008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c7f80-849c-4974-8710-0f1292729413 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.546815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.547406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.547679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.547940 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.548647 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=ae7640a3956e449ebeb41f45eb56aeda) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.548948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.550420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.555934 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 307/609] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/role_assignments?user.id=ae7640a3956e449ebeb41f45eb56aeda&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.556695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.567133 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.567752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.568027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.568292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.568943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.569245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.570721 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.585219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 303/610] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.585934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.684998 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ade83-278e-43d7-b2be-2d48e6200761 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.697509 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.705996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e101fe-c35f-43ce-880f-5ee5c19001be None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.726800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.727667 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.728107 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.728531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.741245 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.743225 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.748001 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.748609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.750005 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.750005 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.750295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.750596 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.752405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:40.759182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:40.760243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:40.761422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:40.761422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:40.761422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:40.761422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 308/611] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:40.761648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.766964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 304/612] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.767313 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.779384 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:40.874562 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc35ec-f67a-4f57-b983-07d92ef99ac1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.886766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20874f8-f490-4894-ad35-207cbd6882c6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:40.911242 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.911871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.912148 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.912417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] PATH_INFO: `/v3/users/glance` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.921368 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.922995 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.923848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:40.924451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:40.924893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:40.925169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:40.926308 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:40.926610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:40.927963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:40.934686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:40.935594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:40.936504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 309/613] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:40.937104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.943362 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 305/614] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:40.944510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:40.966383 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.023043 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.052090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432b0ce-83d4-452f-a1ad-073ade6170ca None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.063927 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60699b7e-fdcc-461a-bf59-ada287d7c9bc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.091007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.091765 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.092194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.092554 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.100635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.101228 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.101531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.101792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.102511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:41.102811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.104010 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.104363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.105869 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:41.121279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:41.122482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:41.123582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:41.123582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:41.123582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:41.127045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 310/615] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:41.127675 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.128200 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 306/616] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:41.128941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.213851 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.239814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a07fc5-6416-4786-8bd3-fef871ff0c71 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.248697 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a86ab9-5c65-4e6d-96cb-cbe270eb1a74 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.273481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.278524 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.279149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.279430 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.279715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.287144 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.287410 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.287741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.288013 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.288278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.288832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.288937 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:41.289223 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.290621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:41.300618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:41.301814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:41.302759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 311/617] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:41.303357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.309627 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 307/618] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:41.310611 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.418499 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88cd06-e3a5-479a-8bcd-95b7a6fab323 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.421685 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2833a62-3c46-4d57-bf00-6a31b1513dca None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.458828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.459485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.459764 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.460033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.461674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.462266 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.462693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.462890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.462986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.464286 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:41.465720 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.467365 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.488977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 308/619] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:41.488977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.529222 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.543009 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.544572 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.586951 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceaf4fc-5296-4945-bdd4-477f7d7e9ba4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.620197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.620879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.621152 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.621443 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.628602 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.630070 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:41.642381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:41.643425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 16:03:41.644373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:41.648168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 309/620] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:41.648986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.659164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 312/621] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:41.659164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.693148 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.765925 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c94427-e10a-4f14-89f2-ae15b46475c1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.766269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc13a5-8b79-4da6-ba45-d3ec90a14a9a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.767835 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.805698 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.806204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.806476 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.806640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.806759 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.807373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.807760 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.808042 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.808768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:41.809072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.810725 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.830233 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 313/622] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:41.831053 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:41.885930 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.887381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:41.929081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:41.939232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a0929-329c-4224-8ada-200c05119297 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:41.979514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:41.980556 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:41.980837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:41.984485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:41.996405 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:41.997862 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.000038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 310/623] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:42.000922 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.012181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:42.021044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:42.022025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:42.022920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:42.022920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.022920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:42.027558 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 314/624] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:42.028492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.139123 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f3e09-9ba6-4197-8394-072fa6c4cf21 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.186067 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38a68a-8dc6-475c-821f-99afdff799d0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.189935 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.190602 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.190872 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.191381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.226664 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.227270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.227545 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.227889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.239610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.241057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.243603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:42.256566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:42.257574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:42.258443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:42.258443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.258443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:42.258443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 315/625] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:42.258443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.279848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.281515 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.283796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.382324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2760e9-de60-4a40-8d98-f0fd1ffecd30 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.388840 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 311/626] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:42.389776 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.428421 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.429021 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.429292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.429600 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.430226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.430521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.432120 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.449296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 316/627] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:42.449296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.501931 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551b02f-7897-4729-bc46-a32a2a12ad2c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.503591 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.505206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.541238 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.542306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.542589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.542910 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.543547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.543847 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.545208 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.553494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdc264-9cd4-4503-a8b8-ddac488bbf72 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.561862 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 312/628] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:42.561862 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.590033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.590650 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.590919 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.591186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.601103 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.602587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:42.618061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:42.619058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:42.620670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:42.620670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:42.620670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:42.620670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 317/629] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:42.620670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.678004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c3fbc-d9bd-46c9-8439-bc903caedbeb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.719825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.720760 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.721225 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.721709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.729774 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.731545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.734396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f1b66-cbf8-47c4-87b9-201a0cf36bcb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:42.743149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:42.744037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:42.745021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 313/630] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:42.746481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.746935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.773149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:42.777215 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.777938 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.778143 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.778409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.785385 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.786840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:42.798181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:42.799173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:42.800072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 318/631] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:42.800545 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.864280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bea3bb-a0e9-4303-b62b-429d5e089e2c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.898133 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.898788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.898994 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.899264 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.899894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.900221 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.902482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.907684 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a10ec7-aab4-4b2d-a35e-fca0302a7ee3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:42.914345 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 314/632] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:42.915144 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.941535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12827abc-31b2-4494-a0e1-54dd62b2cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:42.942052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827abc-31b2-4494-a0e1-54dd62b2cbea None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.942321 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827abc-31b2-4494-a0e1-54dd62b2cbea None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.942591 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12827abc-31b2-4494-a0e1-54dd62b2cbea None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.943255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827abc-31b2-4494-a0e1-54dd62b2cbea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:42.943555 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827abc-31b2-4494-a0e1-54dd62b2cbea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:42.944960 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12827abc-31b2-4494-a0e1-54dd62b2cbea None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:42.957271 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 319/633] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:42.958470 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d98ec-6026-4a99-bfd8-488e6563d05f None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:42.958749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d98ec-6026-4a99-bfd8-488e6563d05f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:42.959017 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d98ec-6026-4a99-bfd8-488e6563d05f None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:42.960315 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 320/634] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:42.962929 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d98ec-6026-4a99-bfd8-488e6563d05f None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:42.991705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.005359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.025263 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e57667-0745-4601-a605-01bc295028f2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.060338 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.060931 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.061217 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.061513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.062195 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.062494 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.063919 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.069696 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d98ec-6026-4a99-bfd8-488e6563d05f None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.075767 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 315/635] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.076567 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.104602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bf2d3-f405-4178-af23-175c3a84a02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.105224 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf2d3-f405-4178-af23-175c3a84a02e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.105535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf2d3-f405-4178-af23-175c3a84a02e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.105804 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bf2d3-f405-4178-af23-175c3a84a02e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.112453 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bf2d3-f405-4178-af23-175c3a84a02e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.113912 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bf2d3-f405-4178-af23-175c3a84a02e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-716bf2d3-f405-4178-af23-175c3a84a02e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:43.125948 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:43.126989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:43.128038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 321/636] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:43.128611 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a38795-06e8-4d98-820e-a8e3446c3150 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.128611 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a38795-06e8-4d98-820e-a8e3446c3150 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.128762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a38795-06e8-4d98-820e-a8e3446c3150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.146170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-17a38795-06e8-4d98-820e-a8e3446c3150 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:43.147351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-17a38795-06e8-4d98-820e-a8e3446c3150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:43.180992 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35793e-31db-4651-bd90-d663768fabe1 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.217842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.218433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.218702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.218968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.219680 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=c222aec3576b436b8bfcef46f12751ff) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.219979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.220423 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 322/637] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:43.221433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.221649 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a38795-06e8-4d98-820e-a8e3446c3150 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.227394 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 316/638] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/role_assignments?user.id=c222aec3576b436b8bfcef46f12751ff&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.228021 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.242466 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.248525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.352791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a38795-06e8-4d98-820e-a8e3446c3150 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.374939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc60a9-781d-4a96-993f-f21baae43183 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.394740 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.395353 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.395626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.395895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.396696 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=738338255eae424ebc3ab73e2cf6b203) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.396999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.398615 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.412994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 323/639] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/role_assignments?user.id=738338255eae424ebc3ab73e2cf6b203&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.421066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.421736 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.422014 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.422284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.423010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.423315 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.424881 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.441772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 317/640] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.447944 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.617202 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.689877 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.707972 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:43.722771 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85834f21-d18a-4a86-9d8a-d68cff61f75d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.752959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2acebad-243b-4bbc-8635-c2b5356077d5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.763947 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.764549 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.764825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.765098 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.765889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=30a70853ec1d420b9533cf1d056e170b) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.766218 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:43.767603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:43.774049 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 324/641] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/role_assignments?user.id=30a70853ec1d420b9533cf1d056e170b&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 608 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:43.799332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.799975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.800252 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.800521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.813617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:43.818512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:43.819563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:43.820463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 318/642] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:43.825786 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:43.952006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819d099-3d48-44ae-9ac2-27febb5055fd None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:43.996843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:43.998639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:43.998639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:43.998639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:43.998891 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:43.999064 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.000541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.011173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 325/643] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:44.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.128676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760b36a-988d-4167-95ff-95aaa773e6e2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.157927 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:44.168142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.168772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.169053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.169347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.180621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.182184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:44.199204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:44.200158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:44.201035 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:44.201035 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:44.201035 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:44.201035 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 319/644] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:44.206239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.218708 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:44.314083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f234e-637e-4c28-a3da-238097a74fb2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.351277 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.351929 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.352215 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.352491 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.353137 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:44.353472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.355878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.368350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 326/645] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:44.374605 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.484557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca42177-2fb6-4f53-af85-ae1bc3d0e51c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.521423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.522390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.522867 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.523334 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.533192 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.535134 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:44.551435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:44.552506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:44.553925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:44.556109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 320/646] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:44.562059 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.632823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:44.673829 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129b71e-4e79-45a8-8b65-6402223ffc26 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.709433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.710350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.710854 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.711328 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.712258 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:44.712786 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.715074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:44.733192 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 327/647] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:44.738621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:44.781429 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:44.845250 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b904b07-9ef8-4ab3-b354-d0c23355a76a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:44.880441 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:44.881441 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:44.881964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:44.882510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:44.953716 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:44.955514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.008622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.073953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 321/648] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 16:03:45.079435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.192851 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3d51b-7b92-4856-a351-e0ef5ea54727 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.221164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.231582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.232621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.233098 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.233651 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.245959 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.247800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:45.264513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:45.265474 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:45.266361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:45.266361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:45.266361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:45.268459 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 328/649] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:45.273792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.379039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4da8-a926-492d-833c-fade6493f2a4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.414518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b27332-dbcd-4c68-839f-b2f3284f7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.415117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27332-dbcd-4c68-839f-b2f3284f7d69 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.415392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27332-dbcd-4c68-839f-b2f3284f7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.415660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b27332-dbcd-4c68-839f-b2f3284f7d69 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.416356 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27332-dbcd-4c68-839f-b2f3284f7d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:45.416738 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27332-dbcd-4c68-839f-b2f3284f7d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.418342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b27332-dbcd-4c68-839f-b2f3284f7d69 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.431416 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 322/650] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:45.432539 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.437636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.549015 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b89cf-2222-454f-810a-b4eb0912154e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.586196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.594257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.594547 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.594825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.596178 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faea47-6237-4131-92bf-ea00250fac0e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.596462 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faea47-6237-4131-92bf-ea00250fac0e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.596733 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27faea47-6237-4131-92bf-ea00250fac0e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.598337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 323/651] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:45.603157 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3854-25e5-4a58-bee0-e15cc94ff319 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.603439 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3854-25e5-4a58-bee0-e15cc94ff319 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.603737 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92b3854-25e5-4a58-bee0-e15cc94ff319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.608709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.610403 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:45.622810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:45.623716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:45.624596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:45.625007 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c92b3854-25e5-4a58-bee0-e15cc94ff319 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:45.625007 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c92b3854-25e5-4a58-bee0-e15cc94ff319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:45.626756 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 329/652] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:45.635714 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.699880 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.705427 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 324/653] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:45.764805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633eeb-e83a-4594-8ca5-4263d617a15c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.800687 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb6459-7673-4d2e-863a-7d4f7248c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.801264 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6459-7673-4d2e-863a-7d4f7248c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.801580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6459-7673-4d2e-863a-7d4f7248c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.801865 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb6459-7673-4d2e-863a-7d4f7248c9c3 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.802594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb6459-7673-4d2e-863a-7d4f7248c9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:45.802961 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb6459-7673-4d2e-863a-7d4f7248c9c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.804392 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb6459-7673-4d2e-863a-7d4f7248c9c3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.818221 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 330/654] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:45.824218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b3854-25e5-4a58-bee0-e15cc94ff319 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:45.832116 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf9be2-e2cb-41b6-81fc-f94938c330c2 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.832397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf9be2-e2cb-41b6-81fc-f94938c330c2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.832669 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf9be2-e2cb-41b6-81fc-f94938c330c2 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.834373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 331/655] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:45.839351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83025ba9-90ea-422a-84bf-974346e78c4c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.839656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83025ba9-90ea-422a-84bf-974346e78c4c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.840002 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83025ba9-90ea-422a-84bf-974346e78c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.859802 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-83025ba9-90ea-422a-84bf-974346e78c4c None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:45.861001 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-83025ba9-90ea-422a-84bf-974346e78c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:45.939730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 332/656] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:45.945954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92b3854-25e5-4a58-bee0-e15cc94ff319 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:45.973516 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:45.982304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:45.983084 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:45.983581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:45.983857 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:45.984586 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=ae7640a3956e449ebeb41f45eb56aeda) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:45.984889 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:45.986427 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:45.992618 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 325/657] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:45 2022] GET /identity/v3/role_assignments?user.id=ae7640a3956e449ebeb41f45eb56aeda&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:46.045759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83025ba9-90ea-422a-84bf-974346e78c4c None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.077435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.165861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83025ba9-90ea-422a-84bf-974346e78c4c None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.204846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.205522 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.205802 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.206075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.206908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.209240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:46.221389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:46.222465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:46.223300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 333/658] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:46.230760 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.294066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.336980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48652-09cc-46fc-aff1-80bdecf61342 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.376874 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0b09f-9687-4d1f-ac97-93a84330628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.378056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b09f-9687-4d1f-ac97-93a84330628d None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.378289 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b09f-9687-4d1f-ac97-93a84330628d None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.378557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0b09f-9687-4d1f-ac97-93a84330628d None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.379427 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b09f-9687-4d1f-ac97-93a84330628d None admin] RBAC: Adding query filter params (name=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:46.379733 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b09f-9687-4d1f-ac97-93a84330628d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.381362 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0b09f-9687-4d1f-ac97-93a84330628d None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.389243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 326/659] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:46.389243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4042e-47e7-457a-883d-dcf691b01516 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.389492 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4042e-47e7-457a-883d-dcf691b01516 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.389792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4042e-47e7-457a-883d-dcf691b01516 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.391092 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 327/660] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:46.393051 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4042e-47e7-457a-883d-dcf691b01516 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.406354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.418396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20069f98-50de-447f-afaf-918ee79d09f2 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.453581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c0e5e-ff55-4885-8708-a91dd1cf5a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.454246 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0e5e-ff55-4885-8708-a91dd1cf5a01 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.454503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0e5e-ff55-4885-8708-a91dd1cf5a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.454734 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c0e5e-ff55-4885-8708-a91dd1cf5a01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.455314 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0e5e-ff55-4885-8708-a91dd1cf5a01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.456672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c0e5e-ff55-4885-8708-a91dd1cf5a01 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.462907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-436c0e5e-ff55-4885-8708-a91dd1cf5a01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:46.465794 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:46.466807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:46.467658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 334/661] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:46.468472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5e0e-6e1f-4025-9b53-a73665f6d21e None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.468472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5e0e-6e1f-4025-9b53-a73665f6d21e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.468603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5e0e-6e1f-4025-9b53-a73665f6d21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.488144 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-36cc5e0e-6e1f-4025-9b53-a73665f6d21e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:46.489361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-36cc5e0e-6e1f-4025-9b53-a73665f6d21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:46.519537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4042e-47e7-457a-883d-dcf691b01516 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.562703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.562703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.562703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.562703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.563142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] RBAC: Adding query filter params (type=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:46.563142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.563513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.565629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 335/662] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:46.567239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc5e0e-6e1f-4025-9b53-a73665f6d21e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.575623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 328/663] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/services?type=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:46.675679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.692657 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc5e0e-6e1f-4025-9b53-a73665f6d21e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.732748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.733749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.734207 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.734766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.735585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:46.736066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.737674 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.743580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 336/664] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:46.750544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.873019 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fb7ac-548d-4de7-a11e-d75e1bce63a2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:46.891973 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:46.893720 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:46.914000 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:46.914600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:46.914869 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:46.915136 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:46.915761 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:46.916055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:46.917590 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:46.922609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 329/665] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:47.020590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ed821-a697-4963-baf7-42c630fe885e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.061706 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.062360 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.062636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.062910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.063521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.067863 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:47.075344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:47.076610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:47.077497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 337/666] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:46 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:47.083094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.196787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ccd79-1fa0-41ea-a6a4-123c2ccb7945 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.238148 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20901ba-7aa2-4a2e-adcd-c0771be514e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.238888 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20901ba-7aa2-4a2e-adcd-c0771be514e8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.239067 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20901ba-7aa2-4a2e-adcd-c0771be514e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.239271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20901ba-7aa2-4a2e-adcd-c0771be514e8 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.239909 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20901ba-7aa2-4a2e-adcd-c0771be514e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:47.240205 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20901ba-7aa2-4a2e-adcd-c0771be514e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.241620 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20901ba-7aa2-4a2e-adcd-c0771be514e8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.247126 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 330/667] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:47.252699 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:47.272237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:47.364680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32186f8c-5336-4bd0-bec2-004cd17a85c9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:47.400255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b750eec-dd59-43f7-ac6e-d34eaaf23464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:47.401568 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750eec-dd59-43f7-ac6e-d34eaaf23464 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:47.402002 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750eec-dd59-43f7-ac6e-d34eaaf23464 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:47.402419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b750eec-dd59-43f7-ac6e-d34eaaf23464 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:47.403188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750eec-dd59-43f7-ac6e-d34eaaf23464 None admin] RBAC: Adding query filter params (type=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:47.403633 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750eec-dd59-43f7-ac6e-d34eaaf23464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:47.405140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b750eec-dd59-43f7-ac6e-d34eaaf23464 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:47.411356 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 338/668] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:47 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:48.338650 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affeaf8-664b-470f-a5d0-5fffa0f4e906 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.339403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affeaf8-664b-470f-a5d0-5fffa0f4e906 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.339403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9affeaf8-664b-470f-a5d0-5fffa0f4e906 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.340647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 331/669] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:48.346031 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42629-e591-4304-9bad-c8772934169a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.346433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42629-e591-4304-9bad-c8772934169a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.346602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d42629-e591-4304-9bad-c8772934169a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.364675 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-31d42629-e591-4304-9bad-c8772934169a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:48.365894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-31d42629-e591-4304-9bad-c8772934169a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:48.439653 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 339/670] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 16:03:48.769875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affeaf8-664b-470f-a5d0-5fffa0f4e906 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:48.829664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:48.893153 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9affeaf8-664b-470f-a5d0-5fffa0f4e906 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:48.928482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d577bdf-627d-4485-8209-d4d20166f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:48.929109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d577bdf-627d-4485-8209-d4d20166f782 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.929406 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d577bdf-627d-4485-8209-d4d20166f782 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.929676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d577bdf-627d-4485-8209-d4d20166f782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.941190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d577bdf-627d-4485-8209-d4d20166f782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-7d577bdf-627d-4485-8209-d4d20166f782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:48.947130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:48.948243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:48.949075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 332/671] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:48.955907 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d42629-e591-4304-9bad-c8772934169a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:48.959362 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96910b9-df2d-4b60-acc6-19ccf8912751 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.959667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96910b9-df2d-4b60-acc6-19ccf8912751 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.959935 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96910b9-df2d-4b60-acc6-19ccf8912751 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.961628 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 333/672] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:48.968103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0424-e3bc-44ea-8ca6-d3411aa3b46f None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:48.968386 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0424-e3bc-44ea-8ca6-d3411aa3b46f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:48.968994 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc0424-e3bc-44ea-8ca6-d3411aa3b46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:48.974944 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:48.990750 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4ccc0424-e3bc-44ea-8ca6-d3411aa3b46f None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:48.991957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4ccc0424-e3bc-44ea-8ca6-d3411aa3b46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:49.081495 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 334/673] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:49.089147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d42629-e591-4304-9bad-c8772934169a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.125013 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.125991 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.126463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.127002 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.127872 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:49.128411 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.129978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.139559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 340/674] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:49.145226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0424-e3bc-44ea-8ca6-d3411aa3b46f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.194619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:49.260348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc0424-e3bc-44ea-8ca6-d3411aa3b46f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.298452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e0634-724f-44d4-9e31-0d2373aee017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.299096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0634-724f-44d4-9e31-0d2373aee017 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.299372 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0634-724f-44d4-9e31-0d2373aee017 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.299641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0634-724f-44d4-9e31-0d2373aee017 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.311845 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e0634-724f-44d4-9e31-0d2373aee017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.313387 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e0634-724f-44d4-9e31-0d2373aee017 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-4c2e0634-724f-44d4-9e31-0d2373aee017 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:49.328945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:49.329921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:49.330842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:49.330842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:49.330842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:49.330842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 335/675] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:49.336938 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.351274 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597f53-4406-4ccf-9ecd-c9cfe1306d89 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.351755 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597f53-4406-4ccf-9ecd-c9cfe1306d89 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.351831 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1597f53-4406-4ccf-9ecd-c9cfe1306d89 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.354441 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 336/676] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:49.358480 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5ed30-d5a0-47b6-9dec-fe7f7c85d1df None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.358760 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5ed30-d5a0-47b6-9dec-fe7f7c85d1df None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.359033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e5ed30-d5a0-47b6-9dec-fe7f7c85d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.377954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f3e5ed30-d5a0-47b6-9dec-fe7f7c85d1df None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:49.379154 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f3e5ed30-d5a0-47b6-9dec-fe7f7c85d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:49.449274 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:49.450378 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 337/677] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:49.454618 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5ed30-d5a0-47b6-9dec-fe7f7c85d1df None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.467914 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60d083-3509-4be0-99e5-1e77ed63a12f None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.500445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:49.503859 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.504835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.505308 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.505820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.506680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:49.507212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.509253 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.530199 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 341/678] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:49.532229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.565946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e5ed30-d5a0-47b6-9dec-fe7f7c85d1df None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.601284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be563c-0cfe-4ec2-9442-185d3a8e5d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.601839 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be563c-0cfe-4ec2-9442-185d3a8e5d84 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.602117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be563c-0cfe-4ec2-9442-185d3a8e5d84 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.602394 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be563c-0cfe-4ec2-9442-185d3a8e5d84 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.603023 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be563c-0cfe-4ec2-9442-185d3a8e5d84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.605110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be563c-0cfe-4ec2-9442-185d3a8e5d84 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.637973 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 338/679] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:49 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:49.667394 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a81d24-808e-44f3-accc-b56ccec3cffc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.680424 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648a3e-57f8-4f69-ac97-e73eb2142677 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.680750 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648a3e-57f8-4f69-ac97-e73eb2142677 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.680977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a648a3e-57f8-4f69-ac97-e73eb2142677 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.683132 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 339/680] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:49.689467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85db8-d52a-4ffb-a0a5-98e8ec4ad94a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.689798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85db8-d52a-4ffb-a0a5-98e8ec4ad94a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.690025 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad85db8-d52a-4ffb-a0a5-98e8ec4ad94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.709704 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5ad85db8-d52a-4ffb-a0a5-98e8ec4ad94a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:49.710750 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:49.710934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5ad85db8-d52a-4ffb-a0a5-98e8ec4ad94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:49.740687 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.742714 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.743324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.744068 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.759719 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.761975 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:49.781409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:49.782457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:49.783458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:49.792482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 342/681] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:49.794331 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.809144 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 340/682] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:49 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 16:03:49.810027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85db8-d52a-4ffb-a0a5-98e8ec4ad94a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:49.823284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:49.933674 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072f2fb-a278-4b0c-ac91-042332d91423 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.935878 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad85db8-d52a-4ffb-a0a5-98e8ec4ad94a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:49.974572 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.975932 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.976211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.976482 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.977205 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:49.978023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.979433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:49.985236 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:49.985876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:49.986153 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:49.986413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:49.987057 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:49.988430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.012872 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 341/683] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:49 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:50.013093 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 343/684] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:50.014195 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.094940 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.138747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c366ad-192a-4f59-af73-650c72392a1b None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.146265 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.183364 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.184208 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.184439 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.184713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.199135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.206832 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.208304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:50.224018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:50.225004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:50.225968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:50.225968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:50.225968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:50.225968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 342/685] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:50.232155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.266690 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123724b-0e22-43fb-8f61-0db72eb5b45b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.308490 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.309382 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.309672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.309942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.311007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.312614 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.334493 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 344/686] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:03:50 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:50.362474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8615fa-f87c-4bc6-be31-72e4f1ae4357 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.384667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.421363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.421363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.421363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.421363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.421829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:50.421829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.422475 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.437733 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 343/687] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:50.443621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.558177 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e56e5-fada-4206-8f8c-4c6d5563b91a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.560730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:50.595523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.596157 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.596434 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.596705 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.603801 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.605250 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:50.616626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:50.617553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:50.618835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 345/688] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:50.624297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.730278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670070b-5b52-43cb-ba23-8affb5ae06c5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.767213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0cc2c-7ef7-436a-947f-012f6e1b6127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.767213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0cc2c-7ef7-436a-947f-012f6e1b6127 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.769464 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0cc2c-7ef7-436a-947f-012f6e1b6127 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.769464 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0cc2c-7ef7-436a-947f-012f6e1b6127 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.769464 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0cc2c-7ef7-436a-947f-012f6e1b6127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:50.769464 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0cc2c-7ef7-436a-947f-012f6e1b6127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.770318 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0cc2c-7ef7-436a-947f-012f6e1b6127 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.783265 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 344/689] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:50.789137 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:50.897607 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996577-1a12-4e4e-bda9-9bab216ff5db None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:50.933967 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e745c-aa92-4fce-99bc-50839ba64973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:50.934637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e745c-aa92-4fce-99bc-50839ba64973 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:50.934914 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e745c-aa92-4fce-99bc-50839ba64973 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:50.935186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e745c-aa92-4fce-99bc-50839ba64973 None admin] PATH_INFO: `/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/ae7640a3956e449ebeb41f45eb56aeda/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:50.937244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e745c-aa92-4fce-99bc-50839ba64973 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3887437d064297aba3a0bf12f93d78, user_id=ae7640a3956e449ebeb41f45eb56aeda, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:50.938751 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767e745c-aa92-4fce-99bc-50839ba64973 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:50.956346 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 346/690] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:03:50 2022] PUT /identity/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/ae7640a3956e449ebeb41f45eb56aeda/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:03:52.068431 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f28e-59e3-42ac-ba76-1969bf183094 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.069419 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f28e-59e3-42ac-ba76-1969bf183094 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.069918 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784f28e-59e3-42ac-ba76-1969bf183094 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.071487 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 345/691] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:52.077183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad1ef-5b93-47d0-97be-8003a87c44e3 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.077682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad1ef-5b93-47d0-97be-8003a87c44e3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.077760 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad1ef-5b93-47d0-97be-8003a87c44e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.096631 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-99aad1ef-5b93-47d0-97be-8003a87c44e3 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:52.097950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-99aad1ef-5b93-47d0-97be-8003a87c44e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:52.117178 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:52.177667 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 347/692] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:52.375976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c05ed-4390-49df-a66f-398667cad67e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.376149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c05ed-4390-49df-a66f-398667cad67e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.376432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c05ed-4390-49df-a66f-398667cad67e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.378162 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 346/693] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:52.383312 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281665-0cce-404f-bfbd-738b1490e14b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.383597 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281665-0cce-404f-bfbd-738b1490e14b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.383866 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a281665-0cce-404f-bfbd-738b1490e14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.402876 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-0a281665-0cce-404f-bfbd-738b1490e14b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:52.404048 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-0a281665-0cce-404f-bfbd-738b1490e14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:52.478245 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 348/694] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:52.519150 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c05ed-4390-49df-a66f-398667cad67e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.556843 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:52.611076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e062-f0a9-4afc-88ef-d1118b0562cf None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.611452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e062-f0a9-4afc-88ef-d1118b0562cf None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.612033 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6e062-f0a9-4afc-88ef-d1118b0562cf None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.614058 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 349/695] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:52.618855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad08fe7-b1aa-49f6-9a72-43f3580f22c5 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.619138 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad08fe7-b1aa-49f6-9a72-43f3580f22c5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.619983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad08fe7-b1aa-49f6-9a72-43f3580f22c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.634788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c05ed-4390-49df-a66f-398667cad67e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:52.637869 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-0ad08fe7-b1aa-49f6-9a72-43f3580f22c5 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:52.639155 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-0ad08fe7-b1aa-49f6-9a72-43f3580f22c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:52.675288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:52.675910 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.676183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.676448 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] PATH_INFO: `/v3/services/image` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.677213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:52.678719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:52.690568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:52.691629 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:52.692474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 347/696] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:52.702342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.729413 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 350/697] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:52 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:52.817071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:52.821702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315bf48e-0285-446b-8640-7721525dbc5c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:52.845472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad08fe7-b1aa-49f6-9a72-43f3580f22c5 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.861135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:52.864049 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:52.864955 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:52.865415 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:52.866100 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:52.866903 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] RBAC: Adding query filter params (name=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:52.867352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:52.870047 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:52.877251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 348/698] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:52.882828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:52.955528 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad08fe7-b1aa-49f6-9a72-43f3580f22c5 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.001100 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.001843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.002235 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.002604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.003284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.004989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.011605 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7909152-149a-47dc-bf15-526ae73cee52 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:53.014778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:53.015968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:53.016983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:53.023197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 351/699] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:53.024358 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.057376 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.058533 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.058980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.059405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.060335 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] RBAC: Adding query filter params (type=image) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:53.061099 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.063248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.069043 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 349/700] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:53.069946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.101480 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.118312 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.144527 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49209aff-caca-413b-b428-5d6bf9453fb7 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.178878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.179621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.179829 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.180097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.180716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:53.181166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.182493 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.187768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 352/701] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:53.188622 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.194611 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e70303-72a9-44a2-a38d-80d63eb9eee3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.236164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.236715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.236993 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.237262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] PATH_INFO: `/v3/services/network` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.237882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.239354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:53.248186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:53.249168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:53.250042 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 350/702] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:53.250828 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.301410 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7cf10a-3728-4628-8226-f6911e35f026 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.337152 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.337780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.338802 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.339079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.339764 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] RBAC: Adding query filter params (interface=public, service_id=c8f83671e72446d185d5d0bd332c137d, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:53.340065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.341435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.348603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 353/703] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/endpoints?service_id=c8f83671e72446d185d5d0bd332c137d&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:53.349438 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.353394 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.359928 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.367006 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb0751-fbc1-439b-8942-12e73e72a273 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.402023 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890d894-fa01-49bd-8f02-3a0f916a20db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.402617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d894-fa01-49bd-8f02-3a0f916a20db None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.402889 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d894-fa01-49bd-8f02-3a0f916a20db None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.403156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890d894-fa01-49bd-8f02-3a0f916a20db None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.403764 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890d894-fa01-49bd-8f02-3a0f916a20db None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:53.404059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890d894-fa01-49bd-8f02-3a0f916a20db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.405451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890d894-fa01-49bd-8f02-3a0f916a20db None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.410015 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 351/704] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:53.411129 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948983e-a057-459a-90cf-c4bb950cd6b8 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.411406 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948983e-a057-459a-90cf-c4bb950cd6b8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.411672 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948983e-a057-459a-90cf-c4bb950cd6b8 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.413007 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 352/705] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:53.413518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948983e-a057-459a-90cf-c4bb950cd6b8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.458151 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587860ec-21c1-441a-9824-1c6c9a164156 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.491475 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.492082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.492355 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.492624 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.493234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] RBAC: Adding query filter params (name=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:53.493556 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.494949 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.499306 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 354/706] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:53.500065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.521336 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948983e-a057-459a-90cf-c4bb950cd6b8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.555911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c247cc5-ae91-482f-a4de-5c58e3feb717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.556511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247cc5-ae91-482f-a4de-5c58e3feb717 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.556789 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247cc5-ae91-482f-a4de-5c58e3feb717 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.557066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c247cc5-ae91-482f-a4de-5c58e3feb717 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.557710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c247cc5-ae91-482f-a4de-5c58e3feb717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.559672 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c247cc5-ae91-482f-a4de-5c58e3feb717 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.566347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 353/707] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services => generated 1002 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:03:53.567515 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3fe94-5617-494c-8ef1-2757bba3c34a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.567798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3fe94-5617-494c-8ef1-2757bba3c34a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.568068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3fe94-5617-494c-8ef1-2757bba3c34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.568805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.599610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-e7e3fe94-5617-494c-8ef1-2757bba3c34a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:53.602043 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e7e3fe94-5617-494c-8ef1-2757bba3c34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:53.607293 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425e6d3-c58d-42c6-9e1f-5a231ea41e79 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.620701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.647536 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.648701 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.648701 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.648701 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.649419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] RBAC: Adding query filter params (interface=public, service_id=7a16f625309742f5bf475d9f2d4c51dd, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:53.649729 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.651487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.661910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 355/708] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/endpoints?service_id=7a16f625309742f5bf475d9f2d4c51dd&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:53.661910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.689425 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 354/709] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:53 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:53.693565 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3fe94-5617-494c-8ef1-2757bba3c34a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.813946 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69d4b5-3962-478c-a331-fecdb6fbe60c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.815557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3fe94-5617-494c-8ef1-2757bba3c34a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:53.854617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.855228 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.855509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.855779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.856384 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.857791 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.858601 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:53.859986 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:53.860416 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:53.860954 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:53.861869 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] RBAC: Adding query filter params (type=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:53.862318 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:53.863804 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:53.863931 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 355/710] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services => generated 1002 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:03:53.865628 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:53.871118 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 356/711] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:53.876614 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:53.918576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.004690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87c4d6-ab22-4a56-b61c-268a9727a4b4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.032107 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.045397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.046073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.046350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.046617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.047479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] RBAC: Adding query filter params (interface=public, service_id=99f0760c825e43e084d17a0fa7026725, region_id=RegionOne) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.047788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.049163 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.057884 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 356/712] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 17 16:03:53 2022] GET /identity/v3/endpoints?service_id=99f0760c825e43e084d17a0fa7026725&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:54.062952 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.160497 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.168076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9362d-5878-4c8b-a4a8-5ac933538896 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.190256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb2b2f-1de8-4515-892e-f4c19c359f9c None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.217108 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.218189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.218902 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.219570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.226554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.227273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.227677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.228045 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.229471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.231177 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.233771 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:03:54.237582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 357/713] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/services => generated 1002 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:03:54.239799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:54.240768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:03:54.241655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:54.246551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 357/714] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:03:54.247612 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.366403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d68634-fc0e-43f4-aef9-1c22783d95f5 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.406352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.406980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.407254 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.407528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.408211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.408513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.409962 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.420429 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 358/715] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:54.426189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.495130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.537730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a95cb-73db-4f44-b384-69b414b2fc34 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.573679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.574308 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.574584 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.574853 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.585159 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.586627 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:54.602226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:54.603208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:54.604585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:54.604585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:54.604585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:54.604585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 358/716] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:54.609374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.612310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.713505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d490e1-84c7-4477-a0d5-9a956a3a5b9f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.750300 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.750911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.751188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.751467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.752110 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:54.752410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.753814 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.766676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 359/717] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:54.772363 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:54.891520 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38501e8f-6df5-4e13-b410-83c11b6eeb46 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:54.903217 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:54.928096 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:54.929140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:54.929650 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:54.930248 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:54.938539 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:54.940245 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:03:54.952815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:54.953842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 16:03:54.954812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:54.957377 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 359/718] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:54.962713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.041126 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:55.078319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8619e2d-4276-4647-850a-e10835f4a393 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.115089 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:55.115973 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.116402 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.116831 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.117728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:55.118176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:55.120346 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:55.138997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 360/719] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 17 16:03:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:55.144746 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.252498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d92db6-eaed-4c92-a2d8-0d7478c8ed04 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.288173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:55.288785 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.289065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.289347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.337683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:55.365164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:55.366717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:55.475895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 360/720] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:55 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:03:55.481591 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.587864 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b35e2d-0f0c-4449-8440-7e5e0df3ef20 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.609956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:55.624234 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:55.625182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.625832 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.626317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.637748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:55.639481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:03:55.654917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:55.655941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:03:55.656861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:03:55.656861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:03:55.656861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:55.658914 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 361/721] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:55.666981 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.743305 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:55.780087 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab22f6-5b83-46a8-bbe6-a80b24cb396d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.818435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23c939-0675-4078-811d-e720bf0017ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:55.819043 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c939-0675-4078-811d-e720bf0017ac None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.819323 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c939-0675-4078-811d-e720bf0017ac None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.819599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23c939-0675-4078-811d-e720bf0017ac None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.820243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23c939-0675-4078-811d-e720bf0017ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:55.820545 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23c939-0675-4078-811d-e720bf0017ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:55.822021 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23c939-0675-4078-811d-e720bf0017ac None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:55.836747 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 361/722] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:55.843237 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:55.941403 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd936f-3788-4a86-b8e9-bfecfbcec49d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.941692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd936f-3788-4a86-b8e9-bfecfbcec49d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.941967 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd936f-3788-4a86-b8e9-bfecfbcec49d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.943493 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 362/723] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:55.950815 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060cb01-c2f4-4a97-a385-ad0d42844d40 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:55.951391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060cb01-c2f4-4a97-a385-ad0d42844d40 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:55.951862 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9060cb01-c2f4-4a97-a385-ad0d42844d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:55.951968 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddf95a-819b-4fdf-a542-3079e8d7f536 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:55.979458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-9060cb01-c2f4-4a97-a385-ad0d42844d40 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:55.979458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-9060cb01-c2f4-4a97-a385-ad0d42844d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:56.010322 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:56.011586 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.012552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.013280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.022322 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:56.024703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:03:56.044714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:56.045976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:03:56.046856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:56.047957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 362/724] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:56.053307 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.060211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 363/725] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:55 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:56.090603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:56.170813 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a4dfd-d457-48f0-a400-136654eaa5c4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:56.206856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e537-7184-483b-a7f4-55fc589d9951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:56.207462 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e537-7184-483b-a7f4-55fc589d9951 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.207742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e537-7184-483b-a7f4-55fc589d9951 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.208010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e537-7184-483b-a7f4-55fc589d9951 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.208696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e537-7184-483b-a7f4-55fc589d9951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:56.208997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e537-7184-483b-a7f4-55fc589d9951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:56.210483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3033e537-7184-483b-a7f4-55fc589d9951 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:56.224827 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 363/726] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:56.230867 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060cb01-c2f4-4a97-a385-ad0d42844d40 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.293600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953e5d-89db-44f0-a988-52ac6e5c0687 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.293916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953e5d-89db-44f0-a988-52ac6e5c0687 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.294143 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82953e5d-89db-44f0-a988-52ac6e5c0687 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.295751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 364/727] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:56.299293 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:56.300689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64660ee-8248-4950-9f5e-82859f675eef None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.300975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64660ee-8248-4950-9f5e-82859f675eef None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.301249 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64660ee-8248-4950-9f5e-82859f675eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.319884 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a64660ee-8248-4950-9f5e-82859f675eef None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:56.321079 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a64660ee-8248-4950-9f5e-82859f675eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:56.345466 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9060cb01-c2f4-4a97-a385-ad0d42844d40 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:56.383952 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:56.385535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.386081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.386581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.387575 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=ae7640a3956e449ebeb41f45eb56aeda) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:56.388085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:56.389774 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:56.397211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 364/728] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/role_assignments?user.id=ae7640a3956e449ebeb41f45eb56aeda&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:56.398307 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 365/729] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:56.398729 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.522196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3698e5-22b5-4501-b5ae-edd89891c0b0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:56.523326 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb844b-8464-46c1-a86d-8b512b1fda75 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.523766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb844b-8464-46c1-a86d-8b512b1fda75 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.523939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb844b-8464-46c1-a86d-8b512b1fda75 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.529982 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 366/730] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:56.535698 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc375-b972-4398-9f15-c4b96f5342e9 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.535998 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc375-b972-4398-9f15-c4b96f5342e9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.536242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc375-b972-4398-9f15-c4b96f5342e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.554976 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:56.558094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ea7fc375-b972-4398-9f15-c4b96f5342e9 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:56.560624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ea7fc375-b972-4398-9f15-c4b96f5342e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:56.567743 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:56.568389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.568671 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.569013 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] PATH_INFO: `/v3/services/image` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.569640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:56.571222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:56.581484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:56.582531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:56.583354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 365/731] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:56.585173 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:56.590687 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.654814 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 367/732] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:56 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:03:56.712072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9b959-a63a-4c91-805d-a7ef42f40a3b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:56.748757 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:56.749721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.750194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.750679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.751500 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] RBAC: Adding query filter params (name=image) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:56.752089 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:56.753668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:56.756995 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc375-b972-4398-9f15-c4b96f5342e9 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.760549 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 366/733] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:56.766089 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.825796 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:56.889975 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290300e7-e365-46c3-9577-eb863ff1738b None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:56.894902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc375-b972-4398-9f15-c4b96f5342e9 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:56.936521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:56.938333 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.938618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.939022 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.939814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] RBAC: Adding query filter params (type=image) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:56.940268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:56.942085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:56.944024 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:56.945246 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:56.945993 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:56.946461 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:56.947829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:56.949861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:56.952861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 367/734] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:56.953752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:56.964226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:56.965247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 16:03:56.966096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:56.969674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 368/735] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:56.976865 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.004004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.082763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff2f4a-2c1a-4b9d-9d40-93573672baa5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.096991 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc0555-b747-494b-89e0-095cab9ff882 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.100298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.120190 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.120791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.121071 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.121568 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.122126 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.123478 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.132150 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.132750 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.133032 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.133301 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.133953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:57.134257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.136466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.145613 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 368/736] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:03:57.146643 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.149149 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 369/737] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:57.150203 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.247896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.272146 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63179618-2b8f-47c5-96ec-ae624b244973 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.324864 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc423dc7-e85a-44e3-a8d3-6336b7324a79 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.325897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.326882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.327231 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.328581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.329306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:57.329715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.331222 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.341578 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 370/738] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 17 16:03:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:57.344525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.382464 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.382761 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.383177 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] PATH_INFO: `/v3/services/network` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.383876 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.386085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:57.399062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:57.400285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 16:03:57.401602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:03:57.403859 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 369/739] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:03:57 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:57.405890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.450289 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.477533 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ef9db-6151-4794-8c3a-b79e2feba121 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.516253 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.517429 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.517915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.518390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.519297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.521081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.537689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:57.545226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ff526-3d8f-4d23-a278-2298e934dc50 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.549930 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 371/740] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:57.600299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.600826 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.601195 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.601503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.602144 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] RBAC: Adding query filter params (name=network) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:57.602441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.604511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.610784 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 370/741] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:57.616489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:57.859940 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e56b-0cb4-4c27-a93e-218a8e4ee6a3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:57.895771 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063780ea-5f2b-4c16-9247-9039d65d910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:57.896380 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063780ea-5f2b-4c16-9247-9039d65d910f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:57.896657 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063780ea-5f2b-4c16-9247-9039d65d910f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:57.896928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063780ea-5f2b-4c16-9247-9039d65d910f None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:57.897589 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063780ea-5f2b-4c16-9247-9039d65d910f None admin] RBAC: Adding query filter params (type=network) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:57.897890 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063780ea-5f2b-4c16-9247-9039d65d910f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:57.899255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063780ea-5f2b-4c16-9247-9039d65d910f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:57.909399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 372/742] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:03:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:57.910837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:58.016779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:58.027602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23752f0-cdf9-4deb-815a-5f973206b1af None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:58.064138 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8444d3-839e-49ca-a856-d79e9e022ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:58.064905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8444d3-839e-49ca-a856-d79e9e022ec8 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:58.065275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8444d3-839e-49ca-a856-d79e9e022ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:58.065753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8444d3-839e-49ca-a856-d79e9e022ec8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:58.069557 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8444d3-839e-49ca-a856-d79e9e022ec8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:58.069557 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8444d3-839e-49ca-a856-d79e9e022ec8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:58.100266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 371/743] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:03:57 2022] POST /identity/v3/endpoints => generated 337 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:03:58.757221 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f5a48-0d2f-4f34-8a83-f07d6509d8bb None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:58.757763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f5a48-0d2f-4f34-8a83-f07d6509d8bb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:58.757763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f5a48-0d2f-4f34-8a83-f07d6509d8bb None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:58.759333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 373/744] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:58.764874 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad54f6-96d2-4181-9d24-af7c542ee52b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:58.765302 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad54f6-96d2-4181-9d24-af7c542ee52b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:58.765500 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad54f6-96d2-4181-9d24-af7c542ee52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:58.784896 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d9ad54f6-96d2-4181-9d24-af7c542ee52b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:58.786149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d9ad54f6-96d2-4181-9d24-af7c542ee52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:58.861973 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 372/745] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:58 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:59.191870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f5a48-0d2f-4f34-8a83-f07d6509d8bb None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:59.252855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:59.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f5a48-0d2f-4f34-8a83-f07d6509d8bb None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:59.337086 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ae11b-ffd4-4998-96ab-17bfc7779c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:59.337768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae11b-ffd4-4998-96ab-17bfc7779c5b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.338655 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae11b-ffd4-4998-96ab-17bfc7779c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.339000 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ae11b-ffd4-4998-96ab-17bfc7779c5b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.339603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae11b-ffd4-4998-96ab-17bfc7779c5b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:59.341007 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ae11b-ffd4-4998-96ab-17bfc7779c5b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-1a7ae11b-ffd4-4998-96ab-17bfc7779c5b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:03:59.350782 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:03:59.351806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:03:59.352696 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:03:59.354350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 374/746] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 17 16:03:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:03:59.358311 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad54f6-96d2-4181-9d24-af7c542ee52b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:59.435936 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:59.463890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad54f6-96d2-4181-9d24-af7c542ee52b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:59.498240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461495f-2f24-4482-b515-2762120261fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:59.498843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461495f-2f24-4482-b515-2762120261fb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.499113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461495f-2f24-4482-b515-2762120261fb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.499376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461495f-2f24-4482-b515-2762120261fb None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.499995 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461495f-2f24-4482-b515-2762120261fb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:59.500343 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461495f-2f24-4482-b515-2762120261fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:59.501749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461495f-2f24-4482-b515-2762120261fb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:59.505944 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3afc8e-1bdd-452b-8c8f-9fee27195e10 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.506295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3afc8e-1bdd-452b-8c8f-9fee27195e10 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.511552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3afc8e-1bdd-452b-8c8f-9fee27195e10 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.511683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 373/747] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:03:59.511788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 375/748] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:03:59.512668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461495f-2f24-4482-b515-2762120261fb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:59.514045 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a1e5-62f0-4ddd-a3e9-5e0242914a80 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.514391 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a1e5-62f0-4ddd-a3e9-5e0242914a80 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.514729 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a1e5-62f0-4ddd-a3e9-5e0242914a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.533996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-3d86a1e5-62f0-4ddd-a3e9-5e0242914a80 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:59.535265 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3d86a1e5-62f0-4ddd-a3e9-5e0242914a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:03:59.604613 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 376/749] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:03:59.622030 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461495f-2f24-4482-b515-2762120261fb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:03:59.656996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c22c8-e4e2-4ca3-8847-518843dc99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:03:59.657616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c22c8-e4e2-4ca3-8847-518843dc99cf None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.657891 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c22c8-e4e2-4ca3-8847-518843dc99cf None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.658156 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c22c8-e4e2-4ca3-8847-518843dc99cf None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.658768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c22c8-e4e2-4ca3-8847-518843dc99cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:03:59.659065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c22c8-e4e2-4ca3-8847-518843dc99cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:03:59.660400 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4c22c8-e4e2-4ca3-8847-518843dc99cf None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:03:59.669693 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 374/750] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 17 16:03:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:03:59.922125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119f29c-e71c-49da-b9f6-8e9a81879c6e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.922611 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119f29c-e71c-49da-b9f6-8e9a81879c6e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.922611 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d119f29c-e71c-49da-b9f6-8e9a81879c6e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.924044 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 377/751] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:03:59.929164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92083cba-40cc-4672-9953-5479c46264d4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:03:59.929580 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92083cba-40cc-4672-9953-5479c46264d4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:03:59.929739 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92083cba-40cc-4672-9953-5479c46264d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:03:59.936212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119f29c-e71c-49da-b9f6-8e9a81879c6e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:03:59.937117 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:03:59.950344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-92083cba-40cc-4672-9953-5479c46264d4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:03:59.951535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-92083cba-40cc-4672-9953-5479c46264d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:00.002856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.031223 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 375/752] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:03:59 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:00.053748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d119f29c-e71c-49da-b9f6-8e9a81879c6e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.089138 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.090112 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.090674 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.091145 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.159946 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.161811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.216857 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.264634 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 378/753] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:03:59 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:04:00.270177 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92083cba-40cc-4672-9953-5479c46264d4 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.366324 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.375663 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92083cba-40cc-4672-9953-5479c46264d4 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.406562 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.411899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.412540 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.412814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.413084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.423544 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.424975 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:04:00.441473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:00.442454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:04:00.443682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:04:00.443682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:04:00.443682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:00.443682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 376/754] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:00.449097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.476430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92ef53-532c-4d3b-b429-707b13f56b03 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.512287 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.512865 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.513135 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.513445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.513989 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.515326 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:00.524124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:00.525103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:00.526433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 379/755] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:04:00.531369 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.550170 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.568970 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7296d62-f5f1-4264-bd81-8cf26f542ca1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.606037 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.606631 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.606900 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.607163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.607785 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:00.608197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.609567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.621788 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 377/756] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:00.643227 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a864e-ce63-4715-b9db-8b63b082fd69 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.681419 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bcf81-8c45-4e05-a1fb-fcb69c5f94d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.682089 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bcf81-8c45-4e05-a1fb-fcb69c5f94d1 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.682365 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bcf81-8c45-4e05-a1fb-fcb69c5f94d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.682660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bcf81-8c45-4e05-a1fb-fcb69c5f94d1 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.683315 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bcf81-8c45-4e05-a1fb-fcb69c5f94d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:00.683617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bcf81-8c45-4e05-a1fb-fcb69c5f94d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.685039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bcf81-8c45-4e05-a1fb-fcb69c5f94d1 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.695418 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 380/757] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:00.696339 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:00.747688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:00.812384 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841306d9-2f50-4bd5-883b-7567434eca88 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:00.847398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c59efd-3395-43a1-9f71-8dcd2e0c9af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:00.848000 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c59efd-3395-43a1-9f71-8dcd2e0c9af7 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:00.848272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c59efd-3395-43a1-9f71-8dcd2e0c9af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:00.848539 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c59efd-3395-43a1-9f71-8dcd2e0c9af7 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:00.849154 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c59efd-3395-43a1-9f71-8dcd2e0c9af7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:00.849483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c59efd-3395-43a1-9f71-8dcd2e0c9af7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:00.851007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c59efd-3395-43a1-9f71-8dcd2e0c9af7 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:00.856996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 378/758] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:01.910327 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f7362-0aa2-4f73-9314-c951f0838e14 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.910860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f7362-0aa2-4f73-9314-c951f0838e14 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.910860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f7362-0aa2-4f73-9314-c951f0838e14 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.912181 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 381/759] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:01.917438 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46528851-5d3e-4e79-880b-7a4114ef8d2d None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:01.917890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46528851-5d3e-4e79-880b-7a4114ef8d2d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:01.917984 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46528851-5d3e-4e79-880b-7a4114ef8d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:01.936831 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-46528851-5d3e-4e79-880b-7a4114ef8d2d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:01.938038 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-46528851-5d3e-4e79-880b-7a4114ef8d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:02.008982 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 379/760] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:01 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:02.331907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f7362-0aa2-4f73-9314-c951f0838e14 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:02.413076 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:02.432723 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f7362-0aa2-4f73-9314-c951f0838e14 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:02.466406 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49789953-de0d-4861-a58b-486a2b1b4c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:02.466999 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789953-de0d-4861-a58b-486a2b1b4c21 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:02.467274 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789953-de0d-4861-a58b-486a2b1b4c21 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:02.467541 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49789953-de0d-4861-a58b-486a2b1b4c21 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:02.468172 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49789953-de0d-4861-a58b-486a2b1b4c21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:02.469560 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49789953-de0d-4861-a58b-486a2b1b4c21 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:02.483446 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 382/761] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:04:02 2022] POST /identity/v3/services => generated 269 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:03.042730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7ed1-f64b-4a18-8c8e-463551eb9485 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.043250 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7ed1-f64b-4a18-8c8e-463551eb9485 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.043250 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf7ed1-f64b-4a18-8c8e-463551eb9485 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.044613 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 380/762] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:03.049937 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222fdf0-aa5b-4197-aab7-988dba4b0c30 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.050359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222fdf0-aa5b-4197-aab7-988dba4b0c30 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.050479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222fdf0-aa5b-4197-aab7-988dba4b0c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.068921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-4222fdf0-aa5b-4197-aab7-988dba4b0c30 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:03.070099 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-4222fdf0-aa5b-4197-aab7-988dba4b0c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:03.140374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 383/763] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:03 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:03.462764 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf7ed1-f64b-4a18-8c8e-463551eb9485 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:03.503279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:03.566787 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf7ed1-f64b-4a18-8c8e-463551eb9485 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:03.600714 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ffcb3-9e4b-40e5-a10b-e55b4d180d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:03.601305 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ffcb3-9e4b-40e5-a10b-e55b4d180d28 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:03.601606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ffcb3-9e4b-40e5-a10b-e55b4d180d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:03.601870 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ffcb3-9e4b-40e5-a10b-e55b4d180d28 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:03.602503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ffcb3-9e4b-40e5-a10b-e55b4d180d28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:03.604426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ffcb3-9e4b-40e5-a10b-e55b4d180d28 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:03.620527 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 381/764] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:04:03 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:04.745468 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1880-4f04-469f-83f3-9fff67be09a9 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:04.745997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1880-4f04-469f-83f3-9fff67be09a9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:04.746082 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e1880-4f04-469f-83f3-9fff67be09a9 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:04.747373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 384/765] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:04.752487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fee48-830c-40c9-9cec-84daf37ce58d None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:04.752888 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fee48-830c-40c9-9cec-84daf37ce58d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:04.753048 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fee48-830c-40c9-9cec-84daf37ce58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:04.770882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3c9fee48-830c-40c9-9cec-84daf37ce58d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:04.772062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3c9fee48-830c-40c9-9cec-84daf37ce58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:04.842533 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 382/766] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:04 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:05.170097 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e1880-4f04-469f-83f3-9fff67be09a9 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.239357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.274501 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e1880-4f04-469f-83f3-9fff67be09a9 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.309205 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.309856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.310129 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.310389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.310956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.312306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:05.321540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:05.323212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:05.324115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 385/767] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:05.330032 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fee48-830c-40c9-9cec-84daf37ce58d None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.356842 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.433031 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fee48-830c-40c9-9cec-84daf37ce58d None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.466304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.466899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.467173 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.467440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.468052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:05.468349 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.469737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.474483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 383/768] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:05.480748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.581825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b2c91-5e46-4d3a-803e-298eda5c2c57 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.610381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.615928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.616525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.616788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.617051 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.617704 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:05.618003 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.620055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.624921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 386/769] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:05.630961 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.722966 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:05.735188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb042f-0247-41aa-8506-39aaaf68bfef None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.772426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e5be7-a694-49f7-a925-c800b9d498c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.773155 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5be7-a694-49f7-a925-c800b9d498c3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.773266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5be7-a694-49f7-a925-c800b9d498c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.773568 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5be7-a694-49f7-a925-c800b9d498c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.774254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e5be7-a694-49f7-a925-c800b9d498c3 None admin] RBAC: Adding query filter params (interface=public, service_id=2069416ec98b449ab520eef6a0b130d0, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:05.774559 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e5be7-a694-49f7-a925-c800b9d498c3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.776313 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e5be7-a694-49f7-a925-c800b9d498c3 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.781212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 384/770] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/endpoints?service_id=2069416ec98b449ab520eef6a0b130d0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:05.786802 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:05.837964 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ce9ed-5ac7-4f9b-b062-450309d949c3 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.837964 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ce9ed-5ac7-4f9b-b062-450309d949c3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.838700 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ce9ed-5ac7-4f9b-b062-450309d949c3 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.839779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 385/771] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:04:05.844751 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd75e3-a62d-4646-ad38-bdb8a6a1271a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.845023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd75e3-a62d-4646-ad38-bdb8a6a1271a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.845470 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd75e3-a62d-4646-ad38-bdb8a6a1271a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.863571 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-97bd75e3-a62d-4646-ad38-bdb8a6a1271a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:05.864741 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-97bd75e3-a62d-4646-ad38-bdb8a6a1271a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:05.889273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8284b2-a56f-42e6-a8a8-ba173c6b7fb6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:05.924285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:05.924879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:05.925156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:05.925454 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:05.926054 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:05.927405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:05.934010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 387/772] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 17 16:04:05 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:04:05.934455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 386/773] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:05 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:04:06.264971 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.324222 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.372073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80399686-18d1-45e0-b4b8-d09e7a6059fb None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.405723 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.406342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.406619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.406888 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.407465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.408824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:06.417954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:06.419164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:06.420190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 388/774] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:06.425070 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd75e3-a62d-4646-ad38-bdb8a6a1271a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.503889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.522309 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd75e3-a62d-4646-ad38-bdb8a6a1271a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.555149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.555738 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.556018 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.556289 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.557641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:06.557950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.559319 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.563968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 387/775] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:06.569842 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.668742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40a0e0-55da-4f19-9cd1-382be3ad6e06 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.695299 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:06.706576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.707174 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.707450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.707718 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.708333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:06.708630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.710020 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.715385 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 389/776] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:06.721432 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.817298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33becb33-b3b1-4e58-808a-8080910271c0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:06.851811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1484a-097e-4e91-98bf-4b9a1b1b680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:06.852525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1484a-097e-4e91-98bf-4b9a1b1b680c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:06.852927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1484a-097e-4e91-98bf-4b9a1b1b680c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:06.853196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1484a-097e-4e91-98bf-4b9a1b1b680c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:06.854438 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1484a-097e-4e91-98bf-4b9a1b1b680c None admin] RBAC: Adding query filter params (interface=public, service_id=3297217308f54992b8f46376a57ad80e, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:06.854737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1484a-097e-4e91-98bf-4b9a1b1b680c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:06.856124 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1484a-097e-4e91-98bf-4b9a1b1b680c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:06.861389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 388/777] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/endpoints?service_id=3297217308f54992b8f46376a57ad80e&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:06.866678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:06.967623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43b2d7-7b28-418c-828c-b3405555ef9f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:07.004644 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ac80d-d16a-4c63-8e41-f78f719843ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:07.005243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ac80d-d16a-4c63-8e41-f78f719843ca None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:07.005554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ac80d-d16a-4c63-8e41-f78f719843ca None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:07.005848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ac80d-d16a-4c63-8e41-f78f719843ca None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:07.006463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ac80d-d16a-4c63-8e41-f78f719843ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:07.007813 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ac80d-d16a-4c63-8e41-f78f719843ca None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:07.013875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 390/778] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 17 16:04:06 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:04:08.116385 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15cd8-cff0-4f2f-b210-8073faf3f555 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.116899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15cd8-cff0-4f2f-b210-8073faf3f555 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.116899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c15cd8-cff0-4f2f-b210-8073faf3f555 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.118270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 389/779] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:08.124610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bee55-4ad2-4417-b183-4083c577548a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.125160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bee55-4ad2-4417-b183-4083c577548a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.125160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bee55-4ad2-4417-b183-4083c577548a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.144522 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7d3bee55-4ad2-4417-b183-4083c577548a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:08.145748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7d3bee55-4ad2-4417-b183-4083c577548a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:08.192351 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:08.211956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 391/780] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:08 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:08.535625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c15cd8-cff0-4f2f-b210-8073faf3f555 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:08.548525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:08.639085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c15cd8-cff0-4f2f-b210-8073faf3f555 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:08.671836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:08.672455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.672728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.672993 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.673625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:08.674957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:08.684090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:08.685046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:08.686170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 390/781] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 17 16:04:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:08.691280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bee55-4ad2-4417-b183-4083c577548a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:08.788542 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bee55-4ad2-4417-b183-4083c577548a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:08.822467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:08.823064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.823361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.823624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.824243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:08.824536 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:08.825932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:08.830549 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 392/782] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 17 16:04:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:08.836184 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:08.912990 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:08.938704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38813859-f619-4cc6-a9c3-de4d65dc988a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:08.971459 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907f32e-7dff-4c54-bca0-4eee134bb70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:08.972055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f32e-7dff-4c54-bca0-4eee134bb70a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:08.972324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f32e-7dff-4c54-bca0-4eee134bb70a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:08.972585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907f32e-7dff-4c54-bca0-4eee134bb70a None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:08.973196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907f32e-7dff-4c54-bca0-4eee134bb70a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:08.973516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907f32e-7dff-4c54-bca0-4eee134bb70a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:08.974861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907f32e-7dff-4c54-bca0-4eee134bb70a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:08.980280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 391/783] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 17 16:04:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:08.986293 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.033930 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.086511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5259b08-c9e3-40a7-a157-bb5a9b903fa7 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.123568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ea27-5600-4c9d-a1c8-866d530e340a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.124169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ea27-5600-4c9d-a1c8-866d530e340a None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.124442 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ea27-5600-4c9d-a1c8-866d530e340a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.124705 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ea27-5600-4c9d-a1c8-866d530e340a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.125397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ea27-5600-4c9d-a1c8-866d530e340a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.126772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ea27-5600-4c9d-a1c8-866d530e340a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.146147 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 393/784] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:04:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:09.258524 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc20df-4f4d-4527-abf3-5d0dfbda139e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.259055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc20df-4f4d-4527-abf3-5d0dfbda139e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.259055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc20df-4f4d-4527-abf3-5d0dfbda139e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.260570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 392/785] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:09.266325 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9c8fc-1eeb-4c24-8d5e-4940d41fe166 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.266609 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9c8fc-1eeb-4c24-8d5e-4940d41fe166 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.266880 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9c8fc-1eeb-4c24-8d5e-4940d41fe166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.292635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-05d9c8fc-1eeb-4c24-8d5e-4940d41fe166 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:09.293980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-05d9c8fc-1eeb-4c24-8d5e-4940d41fe166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:09.377835 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 394/786] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:09 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:09.713636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc20df-4f4d-4527-abf3-5d0dfbda139e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.814443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc20df-4f4d-4527-abf3-5d0dfbda139e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:09.848196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:09.848804 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:09.849080 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:09.849368 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:09.849942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:09.851300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:09.859999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:09.861256 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 16:04:09.862153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:09.865715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 393/787] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:09.867058 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9c8fc-1eeb-4c24-8d5e-4940d41fe166 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:09.894251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:09.967283 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9c8fc-1eeb-4c24-8d5e-4940d41fe166 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.003676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.004276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.004553 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.004824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.005486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:10.005789 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.007151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.011983 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 395/788] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:10.017780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:10.020574 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:10.118577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bef91-353f-4990-84df-3fea43768c26 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.153526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b2702a-65d6-4adc-a02c-3fdd2c5b4915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.154122 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2702a-65d6-4adc-a02c-3fdd2c5b4915 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.154399 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2702a-65d6-4adc-a02c-3fdd2c5b4915 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.154670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b2702a-65d6-4adc-a02c-3fdd2c5b4915 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.155299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2702a-65d6-4adc-a02c-3fdd2c5b4915 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:10.155601 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2702a-65d6-4adc-a02c-3fdd2c5b4915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.156957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b2702a-65d6-4adc-a02c-3fdd2c5b4915 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.162035 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 394/789] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 17 16:04:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:04:10.167901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:10.258150 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:10.268487 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1f4d9-6e37-403c-aeac-4b7d370ffe96 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:10.307862 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e793cf4-bd33-40f3-a21c-3260daeeec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:10.308464 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793cf4-bd33-40f3-a21c-3260daeeec2a None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:10.308741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793cf4-bd33-40f3-a21c-3260daeeec2a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:10.309009 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e793cf4-bd33-40f3-a21c-3260daeeec2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:10.309709 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e793cf4-bd33-40f3-a21c-3260daeeec2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:10.312204 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e793cf4-bd33-40f3-a21c-3260daeeec2a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:10.334029 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 396/790] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:04:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:11.355769 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8e72c-fb90-4008-9331-27d149c451a0 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:11.356269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8e72c-fb90-4008-9331-27d149c451a0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:11.356269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8e72c-fb90-4008-9331-27d149c451a0 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:11.357579 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 395/791] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:11.362846 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5612f-3a70-487b-aece-42626cb878ab None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:11.363272 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5612f-3a70-487b-aece-42626cb878ab None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:11.363451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5612f-3a70-487b-aece-42626cb878ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:11.381158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f6a5612f-3a70-487b-aece-42626cb878ab None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:11.382367 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f6a5612f-3a70-487b-aece-42626cb878ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:11.455980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 397/792] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:04:11.780976 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8e72c-fb90-4008-9331-27d149c451a0 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:11.847027 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:11.886500 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8e72c-fb90-4008-9331-27d149c451a0 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:11.922332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:11.922945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:11.923216 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:11.923481 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:11.924052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:11.925426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:11.934718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:11.935889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:11.936711 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 396/793] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:04:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:11.941939 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5612f-3a70-487b-aece-42626cb878ab None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:12.022364 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:12.050925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5612f-3a70-487b-aece-42626cb878ab None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:12.087441 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41658d27-e77a-46e6-9cc3-0edd73f45cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:12.088041 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658d27-e77a-46e6-9cc3-0edd73f45cbb None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.088319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658d27-e77a-46e6-9cc3-0edd73f45cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.088580 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658d27-e77a-46e6-9cc3-0edd73f45cbb None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.089194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41658d27-e77a-46e6-9cc3-0edd73f45cbb None admin] RBAC: Adding query filter params (name=compute) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:12.089524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41658d27-e77a-46e6-9cc3-0edd73f45cbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:12.090876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41658d27-e77a-46e6-9cc3-0edd73f45cbb None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:12.095432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 398/794] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:04:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:12.101183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:12.202587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75d3c1-ed00-493b-be75-3f44ff7a2b42 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:12.230516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:12.236827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f626f-3dfd-4134-bd8a-b36d4aedad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:12.237467 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f626f-3dfd-4134-bd8a-b36d4aedad1e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.237754 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f626f-3dfd-4134-bd8a-b36d4aedad1e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.238020 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f626f-3dfd-4134-bd8a-b36d4aedad1e None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.238670 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f626f-3dfd-4134-bd8a-b36d4aedad1e None admin] RBAC: Adding query filter params (type=compute) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:12.239096 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f626f-3dfd-4134-bd8a-b36d4aedad1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:12.240455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f626f-3dfd-4134-bd8a-b36d4aedad1e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:12.245488 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 397/795] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:04:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:12.539071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7175db-1742-4597-b8bb-0610e2ad8845 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.539598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7175db-1742-4597-b8bb-0610e2ad8845 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.539598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7175db-1742-4597-b8bb-0610e2ad8845 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.541513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 399/796] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:12.546685 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6828d-e15b-45ad-9fcf-03e950db243a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:12.547118 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6828d-e15b-45ad-9fcf-03e950db243a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:12.547212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6828d-e15b-45ad-9fcf-03e950db243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:12.565390 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d3d6828d-e15b-45ad-9fcf-03e950db243a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:12.566564 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d3d6828d-e15b-45ad-9fcf-03e950db243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:12.632404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 398/797] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:12 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:12.962661 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7175db-1742-4597-b8bb-0610e2ad8845 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:13.066276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7175db-1742-4597-b8bb-0610e2ad8845 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:13.099565 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:13.100160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:13.100436 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:13.100705 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:13.101460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:13.102876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:13.105503 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING keystone.server.flask.common [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 16:04:13.113505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:13.125643 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.sql.core [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:04:13.125643 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 16:04:13.125643 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [parameters: {'id': 'd471174fdd2b4745b97174ef7a109b82', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 16:04:13.125643 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88431) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d471174fdd2b4745b97174ef7a109b82.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d471174fdd2b4745b97174ef7a109b82. Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:04:13.142499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result.read() Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 16:04:13.143479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application yield resource Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise self.value Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application session.commit() Aug 17 16:04:13.144432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:04:13.145389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:04:13.146330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result.read() Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:04:13.147160 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [parameters: {'id': 'd471174fdd2b4745b97174ef7a109b82', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:13.148031 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:13.148805 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d471174fdd2b4745b97174ef7a109b82. Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:13.149742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 400/798] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 17 16:04:12 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:13.150352 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6828d-e15b-45ad-9fcf-03e950db243a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:13.250236 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6828d-e15b-45ad-9fcf-03e950db243a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:13.273449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:13.285202 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fe8f5-dea6-42d8-bf47-74f866555c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:13.285855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe8f5-dea6-42d8-bf47-74f866555c44 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:13.286130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe8f5-dea6-42d8-bf47-74f866555c44 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:13.286396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fe8f5-dea6-42d8-bf47-74f866555c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:13.293688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fe8f5-dea6-42d8-bf47-74f866555c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:13.295110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fe8f5-dea6-42d8-bf47-74f866555c44 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-844fe8f5-dea6-42d8-bf47-74f866555c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:04:13.307327 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:13.308244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:13.309146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 399/799] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:04:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:13.314544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:13.417296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01e541-6ce5-4a88-9505-6ba218864f4a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:13.450253 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f01727-2d2d-4288-89fe-500030633876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:13.450927 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01727-2d2d-4288-89fe-500030633876 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:13.451198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01727-2d2d-4288-89fe-500030633876 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:13.451462 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f01727-2d2d-4288-89fe-500030633876 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:13.452111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01727-2d2d-4288-89fe-500030633876 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:13.452405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01727-2d2d-4288-89fe-500030633876 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:13.454048 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f01727-2d2d-4288-89fe-500030633876 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:13.473543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 401/800] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:04:13 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:14.450908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725a1b-6643-4f3d-bb47-7bde615bf0bb None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:14.451449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725a1b-6643-4f3d-bb47-7bde615bf0bb None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:14.451449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe725a1b-6643-4f3d-bb47-7bde615bf0bb None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:14.452753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 400/801] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:14.458073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b14ee-8155-4cea-a9bc-e45035d4e3cb None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:14.458467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b14ee-8155-4cea-a9bc-e45035d4e3cb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:14.458630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b14ee-8155-4cea-a9bc-e45035d4e3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:14.477301 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-239b14ee-8155-4cea-a9bc-e45035d4e3cb None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:14.478956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-239b14ee-8155-4cea-a9bc-e45035d4e3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:14.528910 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:14.547259 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 402/802] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:14 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:14.880151 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725a1b-6643-4f3d-bb47-7bde615bf0bb None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:14.981619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe725a1b-6643-4f3d-bb47-7bde615bf0bb None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:15.017285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe061a8-4d24-4203-a3f8-1ff0aec53f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:15.017910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe061a8-4d24-4203-a3f8-1ff0aec53f85 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.018184 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe061a8-4d24-4203-a3f8-1ff0aec53f85 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.018452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe061a8-4d24-4203-a3f8-1ff0aec53f85 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.019073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe061a8-4d24-4203-a3f8-1ff0aec53f85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:15.020414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe061a8-4d24-4203-a3f8-1ff0aec53f85 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:15.035923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 401/803] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:04:14 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:04:15.719428 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9344f-5272-4b2d-ac8e-210b61718d2b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.720004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9344f-5272-4b2d-ac8e-210b61718d2b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.720004 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e9344f-5272-4b2d-ac8e-210b61718d2b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.721533 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 403/804] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:15.726511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8a20-83b6-48f9-abf5-e4d9f650ea48 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:15.726932 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8a20-83b6-48f9-abf5-e4d9f650ea48 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:15.727051 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a8a20-83b6-48f9-abf5-e4d9f650ea48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:15.746791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2d2a8a20-83b6-48f9-abf5-e4d9f650ea48 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:15.747959 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2d2a8a20-83b6-48f9-abf5-e4d9f650ea48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:15.787246 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:15.822022 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 402/805] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:15 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:04:16.158481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9344f-5272-4b2d-ac8e-210b61718d2b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:16.262915 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e9344f-5272-4b2d-ac8e-210b61718d2b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:16.297095 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:16.297713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:16.297986 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:16.298249 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:16.298863 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:16.300265 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:16.314137 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.sql.core [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:04:16.314137 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 16:04:16.314137 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [parameters: {'user_id': 'ad4db386dfbe4de098ceaff0dc6293d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 16:04:16.314137 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88431) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result.read() Aug 17 16:04:16.321033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:04:16.322754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application yield resource Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application next(self.gen) Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise self.value Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application session.commit() Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 16:04:16.323712 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.session.flush() Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application compat.raise_( Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 16:04:16.324603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 16:04:16.325571 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application conn.query(q) Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application result.read() Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 16:04:16.326413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ad4db386dfbe4de098ceaff0dc6293d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:16.327241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 16:04:16.329792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 16:04:16.331679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 16:04:16.331679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 16:04:16.331679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 16:04:16.331679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 16:04:16.331679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 16:04:16.331679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:16.331679 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 404/806] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 17 16:04:16 2022] POST /identity/v3/users => generated 160 bytes in 164 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:16.332751 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a8a20-83b6-48f9-abf5-e4d9f650ea48 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:16.444238 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a8a20-83b6-48f9-abf5-e4d9f650ea48 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:16.478793 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa0b10-1766-4912-8197-2ef68398bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:16.479297 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa0b10-1766-4912-8197-2ef68398bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:16.479570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa0b10-1766-4912-8197-2ef68398bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:16.479838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa0b10-1766-4912-8197-2ef68398bdd6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:16.486632 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa0b10-1766-4912-8197-2ef68398bdd6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:16.488050 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa0b10-1766-4912-8197-2ef68398bdd6 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-fdfa0b10-1766-4912-8197-2ef68398bdd6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:04:16.499561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:16.500683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 16:04:16.501806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:16.505434 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 403/807] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:04:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:16.506641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:16.556176 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:16.610127 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a5f21-2106-42c7-b939-7083f1b0e9a3 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:16.642636 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec0090-8539-41e2-80bd-c20870e52350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:16.643230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec0090-8539-41e2-80bd-c20870e52350 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:16.643502 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec0090-8539-41e2-80bd-c20870e52350 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:16.643767 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec0090-8539-41e2-80bd-c20870e52350 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:16.644451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec0090-8539-41e2-80bd-c20870e52350 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:16.644746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec0090-8539-41e2-80bd-c20870e52350 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:16.646392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec0090-8539-41e2-80bd-c20870e52350 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:16.685428 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 405/808] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 17 16:04:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:17.240915 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296407c8-594e-4f8d-b973-20b98d68c0d9 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:17.241449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296407c8-594e-4f8d-b973-20b98d68c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:17.241449 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296407c8-594e-4f8d-b973-20b98d68c0d9 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:17.242983 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 404/809] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:17.248349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271716-54e8-428b-a6ab-87f36596e7f4 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:17.248769 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271716-54e8-428b-a6ab-87f36596e7f4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:17.248893 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271716-54e8-428b-a6ab-87f36596e7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:17.267544 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-41271716-54e8-428b-a6ab-87f36596e7f4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:17.269027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-41271716-54e8-428b-a6ab-87f36596e7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:17.334189 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 406/810] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:17 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:17.661258 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296407c8-594e-4f8d-b973-20b98d68c0d9 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:17.693081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:17.764203 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296407c8-594e-4f8d-b973-20b98d68c0d9 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:17.796697 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:17.797302 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:17.797603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:17.797871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:17.798440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:17.799782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:17.808666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:17.809830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:04:17.811097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 405/811] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:04:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:17.815794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41271716-54e8-428b-a6ab-87f36596e7f4 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:17.848899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:17.913928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41271716-54e8-428b-a6ab-87f36596e7f4 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:17.947101 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:17.947902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:17.948177 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:17.948447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:17.949062 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:17.949381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:17.950734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:17.955467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 407/812] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:04:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:17.961074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:18.057963 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:18.064623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd101c45-98cf-4f17-9a06-4307712f8e37 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:18.101578 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:18.102168 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:18.102442 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:18.102709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:18.103838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] RBAC: Adding query filter params (type=compute) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:18.104133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:18.105504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:18.110103 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 406/813] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:04:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:18.116095 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:18.210965 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:18.215018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cfe11-16dd-4143-bdf3-5b1eb455ef19 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:18.249638 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0849f7e-a03d-4c3f-a66c-f5110bb0ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:18.250229 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849f7e-a03d-4c3f-a66c-f5110bb0ee03 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:18.250492 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849f7e-a03d-4c3f-a66c-f5110bb0ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:18.250759 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0849f7e-a03d-4c3f-a66c-f5110bb0ee03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:18.251444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0849f7e-a03d-4c3f-a66c-f5110bb0ee03 None admin] RBAC: Adding query filter params (interface=public, service_id=e84fe57deb454bc1aeb39069b94d682b, region_id=RegionOne) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:18.251746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0849f7e-a03d-4c3f-a66c-f5110bb0ee03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:18.253099 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0849f7e-a03d-4c3f-a66c-f5110bb0ee03 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:18.258244 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 408/814] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 17 16:04:18 2022] GET /identity/v3/endpoints?service_id=e84fe57deb454bc1aeb39069b94d682b&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:18.263975 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:18.363535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd62e-e15c-4078-8a84-d69bf0b687ae None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:18.395949 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16853f64-0456-4d27-8a41-3eb8308800d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:18.396535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853f64-0456-4d27-8a41-3eb8308800d0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:18.396806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853f64-0456-4d27-8a41-3eb8308800d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:18.397069 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16853f64-0456-4d27-8a41-3eb8308800d0 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:18.397685 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16853f64-0456-4d27-8a41-3eb8308800d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:18.399018 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16853f64-0456-4d27-8a41-3eb8308800d0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:18.406076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 407/815] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 17 16:04:18 2022] GET /identity/v3/services => generated 1728 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:04:20.632146 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c1b3a-ca33-43ca-aec7-2e604b78a051 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:20.632702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c1b3a-ca33-43ca-aec7-2e604b78a051 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:20.632702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c1b3a-ca33-43ca-aec7-2e604b78a051 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:20.634056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 409/816] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:04:20.639189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feac9c-ba51-4e0c-a5c5-0b909f2af4f0 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:20.639627 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feac9c-ba51-4e0c-a5c5-0b909f2af4f0 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:20.639743 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9feac9c-ba51-4e0c-a5c5-0b909f2af4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:20.658195 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e9feac9c-ba51-4e0c-a5c5-0b909f2af4f0 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:04:20.659397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e9feac9c-ba51-4e0c-a5c5-0b909f2af4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:04:20.675962 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:20.726433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 408/817] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:04:20 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:04:21.062069 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c1b3a-ca33-43ca-aec7-2e604b78a051 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.159964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c1b3a-ca33-43ca-aec7-2e604b78a051 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.194543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.195140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.195410 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.195675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.196237 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.198027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:04:21.206523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:04:21.207656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:04:21.208489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 410/818] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:04:21.214014 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feac9c-ba51-4e0c-a5c5-0b909f2af4f0 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.312597 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9feac9c-ba51-4e0c-a5c5-0b909f2af4f0 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.345337 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.345945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.346222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.346492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.347139 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:21.347440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.348793 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.353991 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 409/819] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:21.359715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.388050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:21.458960 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cf2b2-64b9-4bec-bf94-d8e36512f1a6 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.492235 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e2e63-a01e-4090-a6d4-81b5625cfb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.492817 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2e63-a01e-4090-a6d4-81b5625cfb7c None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.493094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2e63-a01e-4090-a6d4-81b5625cfb7c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.493389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e2e63-a01e-4090-a6d4-81b5625cfb7c None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.494030 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2e63-a01e-4090-a6d4-81b5625cfb7c None admin] RBAC: Adding query filter params (type=compute) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:04:21.494359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2e63-a01e-4090-a6d4-81b5625cfb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.495689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e2e63-a01e-4090-a6d4-81b5625cfb7c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.500326 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 411/820] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 17 16:04:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:04:21.506145 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:04:21.524086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:21.604704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14605f6-d0ff-431d-9d79-162a1627c875 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:04:21.636977 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d084071-033e-48aa-9cd2-b6a1e54efe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:04:21.637579 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084071-033e-48aa-9cd2-b6a1e54efe4c None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:04:21.637851 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084071-033e-48aa-9cd2-b6a1e54efe4c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:04:21.638114 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d084071-033e-48aa-9cd2-b6a1e54efe4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:04:21.638751 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d084071-033e-48aa-9cd2-b6a1e54efe4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:04:21.640076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d084071-033e-48aa-9cd2-b6a1e54efe4c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:04:21.660605 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 410/821] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:04:21 2022] POST /identity/v3/endpoints => generated 334 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:04:31.497972 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=55 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:04:31.656454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:24.406892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565c05-0db2-41fd-9301-d3d9daedc749 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.406892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565c05-0db2-41fd-9301-d3d9daedc749 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.406892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63565c05-0db2-41fd-9301-d3d9daedc749 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.408010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 412/822] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:24.414206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41233b9-eada-4ad1-aa93-cfee61547049 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:24.414652 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41233b9-eada-4ad1-aa93-cfee61547049 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:24.415370 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41233b9-eada-4ad1-aa93-cfee61547049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:24.439736 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-f41233b9-eada-4ad1-aa93-cfee61547049 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:24.440947 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f41233b9-eada-4ad1-aa93-cfee61547049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:24.540818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 411/823] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:24 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:24.927119 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63565c05-0db2-41fd-9301-d3d9daedc749 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.059422 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63565c05-0db2-41fd-9301-d3d9daedc749 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.108648 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.109389 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.109732 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.110010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.123141 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.124656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:25.141271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:25.142374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:25.143341 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:25.143341 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:25.143341 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:25.143341 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 413/824] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:25.149578 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41233b9-eada-4ad1-aa93-cfee61547049 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.275534 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41233b9-eada-4ad1-aa93-cfee61547049 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.306379 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.316556 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87be0a6-e172-4cc3-8168-d7ba57e278e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.317164 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87be0a6-e172-4cc3-8168-d7ba57e278e4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.317522 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87be0a6-e172-4cc3-8168-d7ba57e278e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.317806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87be0a6-e172-4cc3-8168-d7ba57e278e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.318401 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87be0a6-e172-4cc3-8168-d7ba57e278e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:25.318788 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87be0a6-e172-4cc3-8168-d7ba57e278e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.320188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87be0a6-e172-4cc3-8168-d7ba57e278e4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.332281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 412/825] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:25.340291 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:25.407352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:25.463444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23c504-f172-4baf-9d18-8d552557ff63 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:25.507040 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fed5f0-338d-4766-ae49-d87d2e6b2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:25.507650 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed5f0-338d-4766-ae49-d87d2e6b2e4c None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:25.507926 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed5f0-338d-4766-ae49-d87d2e6b2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:25.508784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fed5f0-338d-4766-ae49-d87d2e6b2e4c None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:25.509521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fed5f0-338d-4766-ae49-d87d2e6b2e4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:25.510963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fed5f0-338d-4766-ae49-d87d2e6b2e4c None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:25.536456 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 414/826] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 17 16:05:25 2022] POST /identity/v3/users => generated 251 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:05:27.917293 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3d84-2e9d-446b-8130-5d7418e9bb32 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.917888 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3d84-2e9d-446b-8130-5d7418e9bb32 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.917888 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3d84-2e9d-446b-8130-5d7418e9bb32 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.919259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 413/827] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:27.924751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930785-1906-4c5d-bf71-baf79f6fbebe None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:27.925717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930785-1906-4c5d-bf71-baf79f6fbebe None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:27.925717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77930785-1906-4c5d-bf71-baf79f6fbebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:27.945699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-77930785-1906-4c5d-bf71-baf79f6fbebe None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:27.946895 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-77930785-1906-4c5d-bf71-baf79f6fbebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:28.021378 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 415/828] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:28.362967 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3d84-2e9d-446b-8130-5d7418e9bb32 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.482546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3d84-2e9d-446b-8130-5d7418e9bb32 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.517097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.517644 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.517930 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.518684 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.529481 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:28.534301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:28.535266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:28.536106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 414/829] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:28.542355 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930785-1906-4c5d-bf71-baf79f6fbebe None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.592081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.670298 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77930785-1906-4c5d-bf71-baf79f6fbebe None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.711065 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.711794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.712182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.712486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.713156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:28.713494 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.715187 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.725957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 416/830] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:28.732529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:28.785026 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:28.845865 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2e0a6-dd89-4d87-a65a-625616aba1d9 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:28.885678 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:28.886297 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:28.886569 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:28.886841 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:28.898239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:28.900880 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:28.917974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:28.919656 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:28.920669 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:28.920669 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:28.920669 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:28.920669 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 415/831] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:28.924911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.032821 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.036214 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55876afc-a54c-4705-835d-751c1f2b3963 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.071757 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.072364 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.072726 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.072911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.073587 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:29.073890 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.075245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.087109 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 417/832] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:29.093560 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.203761 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.209303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438a9a3-d964-4725-981a-0f7054d4e264 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.244508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.245192 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.245506 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.245779 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.253273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.254927 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:05:29.266232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:29.272175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:29.273136 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 416/833] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:29.273818 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.379826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4f0ac-657d-4754-a717-a8cb47974cd2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.415964 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b365-2349-431e-82df-c95416d2889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.416569 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b365-2349-431e-82df-c95416d2889f None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.416843 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b365-2349-431e-82df-c95416d2889f None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.417102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b365-2349-431e-82df-c95416d2889f None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.417861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b365-2349-431e-82df-c95416d2889f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:29.418173 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b365-2349-431e-82df-c95416d2889f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.419597 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b365-2349-431e-82df-c95416d2889f None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.439213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 418/834] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:29.447090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.561928 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8027fe-f8c9-41ac-864f-d6e6b8693bb0 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.598828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.599347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.599618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.599883 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.628440 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.676188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.678243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.793458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 417/835] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 16:05:29.799328 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b365-2349-431e-82df-c95416d2889f None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:29.824099 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:29.918068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b365-2349-431e-82df-c95416d2889f None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:29.952876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:29.953520 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:29.953793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:29.954102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:29.967106 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:29.968563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:29.986595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:29.987667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:29.989490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:29.989490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:29.989490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:29.989490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 419/836] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:29.995163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.057141 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.106496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6f228-c12c-4a8a-a7bc-6c73b2327b63 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.141659 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.142295 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.142594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.142838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.143487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:30.143797 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.145144 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.156666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 418/837] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:30.163078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.238490 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.278229 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116ee23-5bc1-4e92-abc4-465846a3885a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.318048 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.318678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.318991 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.319225 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.327755 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:05:30.340171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:30.347115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:30.348275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 420/838] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:30.348883 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.459439 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32298e2d-e8ab-4b7b-b6e8-ba4303fa1052 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.479272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.500119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e51b9b-0713-4b55-a46f-aa196da3329e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.500737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e51b9b-0713-4b55-a46f-aa196da3329e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.501013 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e51b9b-0713-4b55-a46f-aa196da3329e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.501284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e51b9b-0713-4b55-a46f-aa196da3329e None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.501999 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e51b9b-0713-4b55-a46f-aa196da3329e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:30.502348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e51b9b-0713-4b55-a46f-aa196da3329e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.503982 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e51b9b-0713-4b55-a46f-aa196da3329e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.520492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 419/839] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:30.530146 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:30.663015 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f52cb8-c2a3-41cb-a003-a584adce84c0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:30.695877 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:30.702392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9b4ff-47b2-41fe-9262-d444b6a81c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:30.703292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b4ff-47b2-41fe-9262-d444b6a81c06 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:30.703594 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b4ff-47b2-41fe-9262-d444b6a81c06 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:30.703867 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9b4ff-47b2-41fe-9262-d444b6a81c06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:30.704614 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b4ff-47b2-41fe-9262-d444b6a81c06 None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=6772c5cbd29741078f90ea0aadb2ddbb) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:30.705056 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b4ff-47b2-41fe-9262-d444b6a81c06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:30.706803 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9b4ff-47b2-41fe-9262-d444b6a81c06 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:30.713811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 421/840] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:30 2022] GET /identity/v3/role_assignments?user.id=6772c5cbd29741078f90ea0aadb2ddbb&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:32.984452 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673f4d-41e7-4227-af30-abab2c150db8 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.985047 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673f4d-41e7-4227-af30-abab2c150db8 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.985047 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb673f4d-41e7-4227-af30-abab2c150db8 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:32.986820 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 420/841] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:32.992151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62838c9-b0ed-430f-9faf-7743a4e39c0e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:32.992631 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62838c9-b0ed-430f-9faf-7743a4e39c0e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:32.992731 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62838c9-b0ed-430f-9faf-7743a4e39c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.014398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d62838c9-b0ed-430f-9faf-7743a4e39c0e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:33.016115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d62838c9-b0ed-430f-9faf-7743a4e39c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:33.093178 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 422/842] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:32 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:33.426307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673f4d-41e7-4227-af30-abab2c150db8 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.545979 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb673f4d-41e7-4227-af30-abab2c150db8 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.588501 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.589152 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.589519 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.589804 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.600351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:33.605128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:33.606268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:33.607417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 421/843] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:33.612499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62838c9-b0ed-430f-9faf-7743a4e39c0e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.723819 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62838c9-b0ed-430f-9faf-7743a4e39c0e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.762319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:33.774918 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.775519 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.775823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.776092 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.776742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] RBAC: Adding query filter params (name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:33.777304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.778689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.787601 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 423/844] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:33.794097 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:33.836786 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:33.909237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405903c-4eb9-4991-b4d9-2b4b29f4a516 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:33.949344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:33.950068 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:33.950483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:33.950966 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:33.963695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:33.965433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:33.985185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:33.986830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:33.987807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:33.987807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:33.987807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:33.987807 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 422/845] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:33.994277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.119320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d99b91-16c8-4696-a0ce-20a5c09cba86 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.161708 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.162335 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.162613 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.162883 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.163543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:34.163897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:34.165503 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:34.182214 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 424/846] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:34.188981 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.300635 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:34.312421 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692d195-cece-4f42-8d4f-f382b0d80cc8 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.354000 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.354627 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.354904 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.355174 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.364845 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:34.366758 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:05:34.382005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:34.383286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:34.384364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 423/847] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:34.392382 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.451334 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:34.523214 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02031bd-db8e-4d95-a74c-ae7032ba0269 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.570222 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.571386 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.571966 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.572247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.573560 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:34.573844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:34.575694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:34.601055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 425/848] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:34.610685 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.734013 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31efd3-621c-4696-b128-2111b57e1e3e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.772147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.772825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.773099 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.773401 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.785908 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:34.787428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:34.806679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:34.807680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:34.808753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:34.808753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:34.808753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:34.808753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 424/849] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:34.816361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:34.933284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e294905-c098-43a4-8062-53bc4e74f0dd None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:34.935581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:34.972628 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:34.973306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:34.973652 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:34.973906 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:34.974600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:34.974952 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:34.976519 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:34.990816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 426/850] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:34.997791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:35.000702 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:35.107105 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fded71-5093-4bfe-8b9f-bc651e257cfb None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:35.144206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:35.144832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.145102 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.145398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.152463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:35.153922 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:05:35.165762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:35.166825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:35.167903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 425/851] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 16:05:35.172810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:35.283787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd429ac-85ff-4e4c-8f92-f10f50635174 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:35.328064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c8ba5-62bb-4a36-a3e9-e9e581a6da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:35.328772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c8ba5-62bb-4a36-a3e9-e9e581a6da26 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.329085 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c8ba5-62bb-4a36-a3e9-e9e581a6da26 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.329439 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c8ba5-62bb-4a36-a3e9-e9e581a6da26 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.330491 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c8ba5-62bb-4a36-a3e9-e9e581a6da26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:35.330988 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c8ba5-62bb-4a36-a3e9-e9e581a6da26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:35.332653 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c8ba5-62bb-4a36-a3e9-e9e581a6da26 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:35.347253 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 427/852] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:35.355360 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:35.422334 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:35.466786 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcca57-cc57-458a-a938-1494682e49ea None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:35.504856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12148995-4af3-40ac-a632-47b1636172e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:35.505534 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12148995-4af3-40ac-a632-47b1636172e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:35.505810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12148995-4af3-40ac-a632-47b1636172e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:35.506082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12148995-4af3-40ac-a632-47b1636172e8 None admin] PATH_INFO: `/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/6772c5cbd29741078f90ea0aadb2ddbb/roles/053c9fe4ac034c11970b0bce8179187c` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:35.520811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12148995-4af3-40ac-a632-47b1636172e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3887437d064297aba3a0bf12f93d78, user_id=6772c5cbd29741078f90ea0aadb2ddbb, role_id=053c9fe4ac034c11970b0bce8179187c)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:35.522307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12148995-4af3-40ac-a632-47b1636172e8 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:35.539080 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 426/853] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:35 2022] PUT /identity/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/6772c5cbd29741078f90ea0aadb2ddbb/roles/053c9fe4ac034c11970b0bce8179187c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:37.775382 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1ba4-0500-47a0-bd55-e71a00a4f017 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:37.776155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1ba4-0500-47a0-bd55-e71a00a4f017 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:37.776155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d1ba4-0500-47a0-bd55-e71a00a4f017 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:37.777521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 428/854] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:37.782680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63832d-b873-43b4-8bbb-934fa2be44ee None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:37.783210 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63832d-b873-43b4-8bbb-934fa2be44ee None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:37.783210 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63832d-b873-43b4-8bbb-934fa2be44ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:37.801394 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-8e63832d-b873-43b4-8bbb-934fa2be44ee None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:37.802589 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-8e63832d-b873-43b4-8bbb-934fa2be44ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:37.871503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 427/855] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:37 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:38.205641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1ba4-0500-47a0-bd55-e71a00a4f017 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:38.235151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:38.322163 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d1ba4-0500-47a0-bd55-e71a00a4f017 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:38.358757 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:38.359382 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.359659 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.359925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.370627 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:38.375359 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:38.376564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:38.377844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 429/856] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 17 16:05:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:38.382748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63832d-b873-43b4-8bbb-934fa2be44ee None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:38.429718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:38.492241 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63832d-b873-43b4-8bbb-934fa2be44ee None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:38.527801 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:38.528402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.528718 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.528945 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.529710 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:38.529942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:38.531258 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:38.547260 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 428/857] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 17 16:05:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:38.548569 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:38.638597 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:38.656242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabded5a-905f-4861-8803-8a7c97837c20 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:38.696180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:38.696817 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.697155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.697449 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.709457 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:38.711099 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:38.728694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:38.734510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:38.735660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:38.735660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:38.735660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:38.735660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 430/858] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:38.735958 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:38.850853 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b7ea7-70df-4d3b-ba20-7b311ad5ebd5 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:38.854415 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:38.890791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:38.891425 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:38.891701 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:38.891964 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:38.892717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:38.893053 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:38.894551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:38.909288 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 429/859] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:38.915765 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.032478 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2665222-1fb7-4f90-997c-e563433847d0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.067376 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.068064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.068315 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.068660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.071910 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.078272 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.079882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:05:39.091742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:39.092797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:39.094188 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 431/860] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:39.098975 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.215523 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02df36f-2ccb-451b-959f-d5036c5d116e None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.251211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.251800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.252071 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.252337 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.253046 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:39.253370 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.254783 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.272465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 430/861] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:05:39.279335 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.393680 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694d670-dbdb-4ebb-9b30-130a1026a561 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.433248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.434005 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.434376 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.434710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.504923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.513144 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.514707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.636770 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 432/862] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:05:39.642590 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.669151 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.752622 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c00b4fd-0e23-4d85-a5b9-bdc76779d3f1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.789691 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.790348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.790629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.790902 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.801861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.803546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:39.820498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:39.822371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:39.823461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:39.823461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:39.823461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:39.823461 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 431/863] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:39.828459 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:39.934344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:39.940908 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea4ccb-6d57-465c-b73d-a1fde1ec9760 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:39.980118 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:39.981044 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:39.981342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:39.981625 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:39.982375 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:39.982707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:39.984524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:39.998888 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 433/864] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:40.004472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.103550 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.136410 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab4995-2eb7-48ad-b536-283671766c37 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.179893 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.180512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.181569 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.182006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.188981 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.190570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:05:40.213483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:40.214630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:40.215906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:40.218139 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 432/865] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:40.222950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.340090 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c6c70-e2b6-46bb-bb59-b6262c6ac3fc None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.377982 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a7b6c-4c42-43cc-bdeb-b6934d424a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.378499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a7b6c-4c42-43cc-bdeb-b6934d424a67 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.378916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a7b6c-4c42-43cc-bdeb-b6934d424a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.379244 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a7b6c-4c42-43cc-bdeb-b6934d424a67 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.380102 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a7b6c-4c42-43cc-bdeb-b6934d424a67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:40.380408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a7b6c-4c42-43cc-bdeb-b6934d424a67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.382151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a7b6c-4c42-43cc-bdeb-b6934d424a67 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.398531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 434/866] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:40.404788 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:40.517830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75de0b-2c35-438e-b625-a43319d6a092 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:40.564666 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa5dee-f931-4b0c-ad4d-dfd5b1b59588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:40.565273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5dee-f931-4b0c-ad4d-dfd5b1b59588 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:40.565566 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5dee-f931-4b0c-ad4d-dfd5b1b59588 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:40.565968 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5dee-f931-4b0c-ad4d-dfd5b1b59588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:40.566563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa5dee-f931-4b0c-ad4d-dfd5b1b59588 None admin] RBAC: Adding query filter params (role.id=053c9fe4ac034c11970b0bce8179187c, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=6772c5cbd29741078f90ea0aadb2ddbb) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:40.566846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa5dee-f931-4b0c-ad4d-dfd5b1b59588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:40.568367 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa5dee-f931-4b0c-ad4d-dfd5b1b59588 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:40.570198 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:40.576429 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 433/867] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:40 2022] GET /identity/v3/role_assignments?user.id=6772c5cbd29741078f90ea0aadb2ddbb&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=053c9fe4ac034c11970b0bce8179187c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:42.963540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f26c1-3319-4948-99d9-7d6009c6e9cc None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.964277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f26c1-3319-4948-99d9-7d6009c6e9cc None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.964277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f26c1-3319-4948-99d9-7d6009c6e9cc None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.965411 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 435/868] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:42.973419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77bb7e-4a3c-4b46-8a58-71a03e5e2cdd None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:42.973419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77bb7e-4a3c-4b46-8a58-71a03e5e2cdd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:42.973419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77bb7e-4a3c-4b46-8a58-71a03e5e2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:42.992260 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7f77bb7e-4a3c-4b46-8a58-71a03e5e2cdd None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:42.994521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7f77bb7e-4a3c-4b46-8a58-71a03e5e2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:43.069766 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 434/869] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:42 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 16:05:43.439739 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f26c1-3319-4948-99d9-7d6009c6e9cc None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.460250 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.564421 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f26c1-3319-4948-99d9-7d6009c6e9cc None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.611738 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.612347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.612620 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.612882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.623766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:43.628466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:43.629837 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:43.630660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 436/870] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:43.636924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77bb7e-4a3c-4b46-8a58-71a03e5e2cdd None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.742715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77bb7e-4a3c-4b46-8a58-71a03e5e2cdd None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.771563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.781446 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.782073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.782348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.782617 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.783292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:43.783593 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.784984 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.795414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 435/871] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:43.802203 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:43.885552 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:43.910765 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfad17-30aa-4e7e-96bf-08133d6d12c2 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:43.946287 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:43.946926 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:43.947203 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:43.947470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:43.959366 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:43.960852 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:43.977072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:43.979525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:43.980417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:43.980417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:43.980417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:43.980417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 437/872] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:43.985181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.090916 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c0588-0b36-4abe-8139-2396c57ba85d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.126547 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.127158 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.127428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.127692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.128332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:44.128626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.130044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.143752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 436/873] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:44.150037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.255233 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378e6a1-2136-4ed1-a26d-4e0cfd33b0f8 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.283614 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.291961 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.292580 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.292855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.293119 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.300622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.302148 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:05:44.313675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:44.314855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:44.315836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 438/874] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:44.320897 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.373680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.425740 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a151cbb-adf9-4774-b488-080b0c333b82 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.459848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.460451 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.460733 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.461005 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.461780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:44.462739 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.464284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.482964 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 437/875] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:44.488704 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.593859 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8a9c9-2792-4eb2-9360-3ee642706298 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.627489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.628027 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.628305 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.628578 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.682678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.695038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.696501 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.792790 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 439/876] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:05:44.798606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:44.896426 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dffb9-8c0f-4ec4-a764-076ae58513be None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:44.906025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:44.936477 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:44.937095 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:44.937402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:44.937671 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:44.948045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:44.949496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:44.964239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:44.965348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:44.966567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:44.966567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:44.966567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:44.966567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 438/877] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:44.971039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.057114 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:45.068998 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958ba22-0d69-4c33-994c-ffce1b901fc4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.102957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.103596 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.103870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.104135 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.104756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:45.105052 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.106428 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.117153 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 440/878] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:45.122923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.221212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e72e10-4fbd-4a18-86e5-22533a02f85c None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.253879 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.254487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.254763 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.255032 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.262354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.263780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:05:45.275404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:45.276428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:45.277780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 439/879] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:45.282587 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.380334 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05fda1-7e0d-4323-a912-cdf2ea1c96f4 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.413003 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd73439-393f-46af-ae2a-6188e31b8ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.413619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73439-393f-46af-ae2a-6188e31b8ad8 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.413895 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73439-393f-46af-ae2a-6188e31b8ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.414168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd73439-393f-46af-ae2a-6188e31b8ad8 None admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.414835 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73439-393f-46af-ae2a-6188e31b8ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:45.415174 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73439-393f-46af-ae2a-6188e31b8ad8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.416714 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd73439-393f-46af-ae2a-6188e31b8ad8 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.428164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 441/880] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:45.435066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:45.457113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:45.534298 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb56944-81da-4552-94c2-baf3d6870406 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:45.573183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb73081-0671-4304-af88-8764f7b94511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:45.573896 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73081-0671-4304-af88-8764f7b94511 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:45.574352 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73081-0671-4304-af88-8764f7b94511 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:45.574553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73081-0671-4304-af88-8764f7b94511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:45.575541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb73081-0671-4304-af88-8764f7b94511 None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=6772c5cbd29741078f90ea0aadb2ddbb) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:45.575809 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb73081-0671-4304-af88-8764f7b94511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:45.577594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb73081-0671-4304-af88-8764f7b94511 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:45.583978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 440/881] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:45 2022] GET /identity/v3/role_assignments?user.id=6772c5cbd29741078f90ea0aadb2ddbb&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:47.762909 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aced1-64fe-4584-b8d9-cdd6d9ed5742 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.763469 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aced1-64fe-4584-b8d9-cdd6d9ed5742 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.763469 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14aced1-64fe-4584-b8d9-cdd6d9ed5742 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.765104 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 442/882] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:47.770419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ecf10-baff-4458-b509-6570eadf9e0a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:47.770831 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ecf10-baff-4458-b509-6570eadf9e0a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:47.770963 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ecf10-baff-4458-b509-6570eadf9e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:47.788680 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a30ecf10-baff-4458-b509-6570eadf9e0a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:47.789912 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a30ecf10-baff-4458-b509-6570eadf9e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:47.855460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 441/883] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:48.179261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aced1-64fe-4584-b8d9-cdd6d9ed5742 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.190193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.280293 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14aced1-64fe-4584-b8d9-cdd6d9ed5742 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.313125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.313761 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.314038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.314301 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.324834 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:48.329499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:48.330563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:48.331568 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 443/884] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:48.336476 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ecf10-baff-4458-b509-6570eadf9e0a None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.352197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.436110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ecf10-baff-4458-b509-6570eadf9e0a None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.470129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.470713 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.470987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.471259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.471897 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] RBAC: Adding query filter params (name=admin) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:48.472194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.473563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.481796 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 442/885] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:48.487521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.561488 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.598169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63a1e-222a-43e7-9cce-9b8ea4468d1e None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.635463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.636069 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.636344 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.636612 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.646252 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.647684 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:48.661980 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:48.668746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:48.669985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:48.669985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:48.669985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:48.669985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 444/886] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:48.670268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.746281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.768751 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab6a63-c8e1-4507-9d9a-5cce151bc3af None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.801121 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.801742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.802006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.802276 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.802904 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:48.803206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.804587 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.816445 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 443/887] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:48.822534 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:48.920430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b64d6-0788-4c28-bb54-7f0daa8aeb04 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:48.940089 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:48.953818 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:48.954432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:48.954707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:48.954977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:48.962373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:48.963792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:05:48.974547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:48.975654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:48.976815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 445/888] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:48.982692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.079840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff6d59-7f96-4eed-b429-fde8503bf06d None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.113351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.113930 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.114203 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.114473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.115176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:49.115475 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.116871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.119592 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.136546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 444/889] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 17 16:05:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:49.142823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.241521 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5052d78-72e8-48d1-a6ef-6130ba0084b0 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.273792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.275007 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.275276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.275537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.285848 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.287262 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:49.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:49.303198 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:49.304280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:49.304280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:49.304280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:49.304280 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 446/890] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:49.310125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.407812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e19770-4945-4a75-a082-a45e069bd9cc None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.440422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.441007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.441285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.441585 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.442205 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:49.442506 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.443849 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.455767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 445/891] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:49.462870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.494055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.568874 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1d43-129d-45c0-94bd-31d73fa51b23 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.603153 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.603767 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.604039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.604303 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.610886 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.612310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:05:49.623353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:49.624381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:49.625296 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 447/892] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:49.630277 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.684596 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.728557 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3149-7336-428c-808d-7d00c93328f4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.760496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929f8d-910b-41bd-bc9e-1a453fbd5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.761073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929f8d-910b-41bd-bc9e-1a453fbd5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.761372 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929f8d-910b-41bd-bc9e-1a453fbd5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.761643 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929f8d-910b-41bd-bc9e-1a453fbd5dd1 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.762313 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba929f8d-910b-41bd-bc9e-1a453fbd5dd1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:49.762613 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba929f8d-910b-41bd-bc9e-1a453fbd5dd1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.764022 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba929f8d-910b-41bd-bc9e-1a453fbd5dd1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.776186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 446/893] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:49.782542 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:49.872091 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:49.880676 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b075f0d-5b37-42fb-b096-0f7aea638000 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:49.913433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72f1ac-a4bf-4392-81a1-0ada46bfd827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:49.914071 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72f1ac-a4bf-4392-81a1-0ada46bfd827 None admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:49.914348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72f1ac-a4bf-4392-81a1-0ada46bfd827 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:49.914617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72f1ac-a4bf-4392-81a1-0ada46bfd827 None admin] PATH_INFO: `/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/6772c5cbd29741078f90ea0aadb2ddbb/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:49.916602 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72f1ac-a4bf-4392-81a1-0ada46bfd827 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d3887437d064297aba3a0bf12f93d78, user_id=6772c5cbd29741078f90ea0aadb2ddbb, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:49.918044 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72f1ac-a4bf-4392-81a1-0ada46bfd827 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:49.930219 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 448/894] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 17 16:05:49 2022] PUT /identity/v3/projects/4d3887437d064297aba3a0bf12f93d78/users/6772c5cbd29741078f90ea0aadb2ddbb/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:05:52.159865 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406657-f98f-48cd-aaba-e3459aafd35b None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.160415 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406657-f98f-48cd-aaba-e3459aafd35b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.160514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1406657-f98f-48cd-aaba-e3459aafd35b None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.161860 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 447/895] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:52.167719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37ea01-4a90-4f9b-b7ad-6007fd43ae6a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.168103 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37ea01-4a90-4f9b-b7ad-6007fd43ae6a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.168259 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37ea01-4a90-4f9b-b7ad-6007fd43ae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.186078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-aa37ea01-4a90-4f9b-b7ad-6007fd43ae6a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:52.187239 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-aa37ea01-4a90-4f9b-b7ad-6007fd43ae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:52.257294 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 449/896] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:52 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:52.607345 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406657-f98f-48cd-aaba-e3459aafd35b None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.707846 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1406657-f98f-48cd-aaba-e3459aafd35b None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.723116 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.743073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.743942 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.744212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.744478 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.754196 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 16:05:52.759541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:52.760645 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:52.761858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 448/897] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:52.766656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37ea01-4a90-4f9b-b7ad-6007fd43ae6a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:52.846832 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:52.865799 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37ea01-4a90-4f9b-b7ad-6007fd43ae6a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:52.903699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:52.904297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:52.904573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:52.904844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:52.905535 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:52.905833 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:52.907194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:52.915403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 450/898] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:52.921192 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:53.022174 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606449f-b30d-444a-a7c6-c8f1dd8e7cf3 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:53.054167 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:53.054776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:53.055054 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:53.055323 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:53.066089 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:53.067508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:53.081742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:53.082828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:53.083924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:53.083924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:53.083924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:53.083924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 449/899] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:53.088711 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:53.186420 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c17713-4dbd-4f02-bedc-52a4d77f5e94 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:53.219362 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:53.219958 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:53.220230 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:53.220500 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:53.221134 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:53.221459 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:53.222816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:53.235170 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 451/900] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:53.240778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:53.269150 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:53.341709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab739-5766-49d2-badb-2e40c45cc7c4 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:53.375695 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:53.376308 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:53.376584 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:53.376852 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:53.383962 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:53.385508 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 16:05:53.396140 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:53.397193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:53.398332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 450/901] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:53.403375 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:53.407094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:53.501598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4372fbd-c0a0-460f-b65f-bf2691869c80 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:53.535751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:53.536345 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:53.536623 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:53.536891 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:53.537635 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:53.537937 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:53.539353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:53.556734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 452/902] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 17 16:05:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:53.562456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:53.645732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:53.660427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b30b0-805d-4ea3-a48d-e89a699e770a None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:53.692957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:53.693570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:53.693843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:53.694108 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:53.759253 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:53.760603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:53.839867 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:53.855006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 451/903] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 17 16:05:53 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 16:05:53.860687 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:53.921105 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:53.958660 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ca8e0-685c-4aaf-b624-40fe48eb2c58 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:53.991931 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:53.992547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:53.992821 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:53.993785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:54.003702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:54.005122 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 16:05:54.019337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:54.020407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 16:05:54.021467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 16:05:54.021467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 16:05:54.021467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:54.021467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 453/904] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:54.026332 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:54.123275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5f7fe-e6ba-4584-9272-8f7fe0c62963 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:54.155791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:54.156371 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:54.156646 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:54.156911 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:54.157558 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:54.157853 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:54.159185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:54.170798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 452/905] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 17 16:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:54.176339 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:54.279212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910763bb-de22-425f-b3cb-d2392805f694 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:54.293579 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:54.313293 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:54.313927 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:54.314200 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:54.314460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:54.320748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:54.322377 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 16:05:54.335756 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:54.337156 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: ERROR keystone.server.flask.application Aug 17 16:05:54.338398 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 454/906] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 17 16:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:54.344026 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:54.390113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:54.443337 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf8bda-6a16-4395-abc8-e33a7c13f619 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:54.475863 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f2d920-bd30-4696-b97a-5ffd098759b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:54.476447 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d920-bd30-4696-b97a-5ffd098759b1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:54.476721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d920-bd30-4696-b97a-5ffd098759b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:54.476990 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2d920-bd30-4696-b97a-5ffd098759b1 None admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:54.478837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2d920-bd30-4696-b97a-5ffd098759b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:54.478953 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2d920-bd30-4696-b97a-5ffd098759b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:54.480362 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f2d920-bd30-4696-b97a-5ffd098759b1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:54.491951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 453/907] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 17 16:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:54.498270 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:54.596659 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8162c6cc-d945-432e-8594-2809c6cd5d94 None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:54.629112 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b4d08-8bca-4be6-91a1-8fc7db619a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:54.629728 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b4d08-8bca-4be6-91a1-8fc7db619a7a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:54.630002 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b4d08-8bca-4be6-91a1-8fc7db619a7a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:54.630271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b4d08-8bca-4be6-91a1-8fc7db619a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:54.630979 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b4d08-8bca-4be6-91a1-8fc7db619a7a None admin] RBAC: Adding query filter params (role.id=8aaf0e0acac14fb88e179fd18d9eaaab, scope.project.id=4d3887437d064297aba3a0bf12f93d78, user.id=6772c5cbd29741078f90ea0aadb2ddbb) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:54.631281 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b4d08-8bca-4be6-91a1-8fc7db619a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:54.632701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b4d08-8bca-4be6-91a1-8fc7db619a7a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:54.641843 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 455/908] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 17 16:05:54 2022] GET /identity/v3/role_assignments?user.id=6772c5cbd29741078f90ea0aadb2ddbb&scope.project.id=4d3887437d064297aba3a0bf12f93d78&role.id=8aaf0e0acac14fb88e179fd18d9eaaab => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:56.815284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c740-d412-421c-9a61-771e468572fc None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.815810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c740-d412-421c-9a61-771e468572fc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.815810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464c740-d412-421c-9a61-771e468572fc None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.817161 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 454/909] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:56.822959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b478e3-0bf0-44f3-a574-d2f8bffbe3ee None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:56.823390 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b478e3-0bf0-44f3-a574-d2f8bffbe3ee None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:56.823509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b478e3-0bf0-44f3-a574-d2f8bffbe3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:56.840976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-46b478e3-0bf0-44f3-a574-d2f8bffbe3ee None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:56.842177 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-46b478e3-0bf0-44f3-a574-d2f8bffbe3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:56.871540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:56.908806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 456/910] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:05:57.233379 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464c740-d412-421c-9a61-771e468572fc None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.333187 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464c740-d412-421c-9a61-771e468572fc None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.340837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:57.367456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.368089 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.368375 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.368642 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.369212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.370595 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:05:57.379052 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:05:57.380229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:05:57.381292 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 455/911] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:05:57.386252 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b478e3-0bf0-44f3-a574-d2f8bffbe3ee None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.481237 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b478e3-0bf0-44f3-a574-d2f8bffbe3ee None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.514689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a77e83-ccf3-462c-95bf-018372c7bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.515213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77e83-ccf3-462c-95bf-018372c7bac3 None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.515483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77e83-ccf3-462c-95bf-018372c7bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.515746 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a77e83-ccf3-462c-95bf-018372c7bac3 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.516689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a77e83-ccf3-462c-95bf-018372c7bac3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:57.516977 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a77e83-ccf3-462c-95bf-018372c7bac3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.518354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a77e83-ccf3-462c-95bf-018372c7bac3 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.522898 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 457/912] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:57.528974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:05:57.643905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6a424-9d3f-4554-aa8c-cb7ce4d367e1 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:05:57.678113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3d6b2-6526-4482-bd6b-7a701abb5322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:05:57.678698 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d6b2-6526-4482-bd6b-7a701abb5322 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:57.678970 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d6b2-6526-4482-bd6b-7a701abb5322 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:57.679237 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3d6b2-6526-4482-bd6b-7a701abb5322 None admin] PATH_INFO: `/v3/services` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:57.679838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3d6b2-6526-4482-bd6b-7a701abb5322 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:05:57.680132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3d6b2-6526-4482-bd6b-7a701abb5322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:05:57.682468 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3d6b2-6526-4482-bd6b-7a701abb5322 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:05:57.686679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 456/913] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 17 16:05:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:05:59.835523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701019-d205-4a71-b392-2dea3a530187 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.836051 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701019-d205-4a71-b392-2dea3a530187 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.836051 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b701019-d205-4a71-b392-2dea3a530187 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.838350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 458/914] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:05:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:05:59.843360 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8862fb-e4cc-48d6-948b-6fead9d37123 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:05:59.843778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8862fb-e4cc-48d6-948b-6fead9d37123 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:05:59.843903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8862fb-e4cc-48d6-948b-6fead9d37123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:05:59.862065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7b8862fb-e4cc-48d6-948b-6fead9d37123 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:05:59.863249 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7b8862fb-e4cc-48d6-948b-6fead9d37123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:05:59.889871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:05:59.929418 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 457/915] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:05:59 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:00.256584 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701019-d205-4a71-b392-2dea3a530187 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:00.288472 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:00.358486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b701019-d205-4a71-b392-2dea3a530187 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:00.394276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f916df8-cf7c-4f55-b6e9-151877b9e973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:00.394868 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916df8-cf7c-4f55-b6e9-151877b9e973 None admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:00.395142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916df8-cf7c-4f55-b6e9-151877b9e973 None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:00.395408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f916df8-cf7c-4f55-b6e9-151877b9e973 None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:00.396045 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f916df8-cf7c-4f55-b6e9-151877b9e973 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:00.397426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f916df8-cf7c-4f55-b6e9-151877b9e973 None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:00.411542 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 459/916] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 17 16:06:00 2022] POST /identity/v3/services => generated 246 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:02.606284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21d2ec-7ec4-4072-83de-40b34611e6cc None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.606851 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21d2ec-7ec4-4072-83de-40b34611e6cc None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.606851 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21d2ec-7ec4-4072-83de-40b34611e6cc None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.608134 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 458/917] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:02.613462 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc1112-57f6-43db-99b2-be32af1080b0 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:02.613928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc1112-57f6-43db-99b2-be32af1080b0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:02.614019 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc1112-57f6-43db-99b2-be32af1080b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:02.632972 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-85fc1112-57f6-43db-99b2-be32af1080b0 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:02.634753 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-85fc1112-57f6-43db-99b2-be32af1080b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:02.709437 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 460/918] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:02 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:03.035479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21d2ec-7ec4-4072-83de-40b34611e6cc None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.133219 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21d2ec-7ec4-4072-83de-40b34611e6cc None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.167304 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.167912 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.168185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.168455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] PATH_INFO: `/v3/services/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.169023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.170395 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:03.178832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:03.179994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:06:03.180920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 459/919] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:03.185881 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc1112-57f6-43db-99b2-be32af1080b0 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.204120 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.285554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc1112-57f6-43db-99b2-be32af1080b0 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.318720 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.319353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.319624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.319951 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.320604 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.321687 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.323168 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.333436 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 461/920] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.334415 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.362774 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.433675 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679714e1-5bf6-4d81-9349-4193b8e707ec None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.466513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc4f826-acdf-48d5-8c60-34074a90a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.467104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4f826-acdf-48d5-8c60-34074a90a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.467384 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4f826-acdf-48d5-8c60-34074a90a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.467657 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc4f826-acdf-48d5-8c60-34074a90a7f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.468441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4f826-acdf-48d5-8c60-34074a90a7f9 None admin] RBAC: Adding query filter params (interface=public, service_id=1aad4df70a5142509646051a7c33a26b, region_id=RegionOne) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:03.468748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4f826-acdf-48d5-8c60-34074a90a7f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.470134 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc4f826-acdf-48d5-8c60-34074a90a7f9 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.474946 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 460/921] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/endpoints?service_id=1aad4df70a5142509646051a7c33a26b&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:03.481576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:03.561795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:03.579748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adb945-c4fd-422e-8205-b966742b4c0a None admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:03.613020 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c736b-d650-4071-a535-10f70cc7508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:03.613630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c736b-d650-4071-a535-10f70cc7508b None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:03.614154 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c736b-d650-4071-a535-10f70cc7508b None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:03.614154 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c736b-d650-4071-a535-10f70cc7508b None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:03.614730 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c736b-d650-4071-a535-10f70cc7508b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:03.616070 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c736b-d650-4071-a535-10f70cc7508b None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:03.623195 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 462/922] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 17 16:06:03 2022] GET /identity/v3/services => generated 1962 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:06:05.765431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145ab8-60af-4403-9c7c-4da58f74e04d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.765963 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145ab8-60af-4403-9c7c-4da58f74e04d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.765963 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0145ab8-60af-4403-9c7c-4da58f74e04d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.767284 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 461/923] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:06:05.772444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec665-7227-4e02-813b-9c951123761e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:05.772870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec665-7227-4e02-813b-9c951123761e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:05.772989 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ec665-7227-4e02-813b-9c951123761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:05.791801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-e31ec665-7227-4e02-813b-9c951123761e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:06:05.792969 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e31ec665-7227-4e02-813b-9c951123761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:06:05.858073 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 463/924] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:06:05 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 16:06:06.183629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0145ab8-60af-4403-9c7c-4da58f74e04d None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.272554 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.282430 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0145ab8-60af-4403-9c7c-4da58f74e04d None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.314780 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.315385 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.315660 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.315924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.316494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.317871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 16:06:06.326301 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 16:06:06.327454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application with Lock( Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self._enter() Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application return self.creator() Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application created_value = creator( Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: ERROR keystone.server.flask.application Aug 17 16:06:06.328280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 462/925] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 16:06:06.333663 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec665-7227-4e02-813b-9c951123761e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.410310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:06.433254 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ec665-7227-4e02-813b-9c951123761e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.465722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7448c7-0a15-42c2-933e-ae804b7f75db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.466306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7448c7-0a15-42c2-933e-ae804b7f75db None admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.466577 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7448c7-0a15-42c2-933e-ae804b7f75db None admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.466840 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7448c7-0a15-42c2-933e-ae804b7f75db None admin] PATH_INFO: `/v3/services` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.467448 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7448c7-0a15-42c2-933e-ae804b7f75db None admin] RBAC: Adding query filter params (name=placement) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:06:06.467741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7448c7-0a15-42c2-933e-ae804b7f75db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.469187 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7448c7-0a15-42c2-933e-ae804b7f75db None admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.474038 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 464/926] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 17 16:06:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:06:06.480703 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:06:06.576740 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fed3e6-19cb-47b4-a766-fa8541cccf76 None admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:06:06.609368 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881307f-bc4c-4d4e-946c-725b75df8208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:06:06.609953 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881307f-bc4c-4d4e-946c-725b75df8208 None admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:06:06.610227 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881307f-bc4c-4d4e-946c-725b75df8208 None admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:06:06.610493 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881307f-bc4c-4d4e-946c-725b75df8208 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:06:06.611146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881307f-bc4c-4d4e-946c-725b75df8208 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:06:06.612487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881307f-bc4c-4d4e-946c-725b75df8208 None admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:06:06.631473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 463/927] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:06:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:06:16.471140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=30 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:06:16.627707 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:06.747432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f980-0ba8-4ad8-8b7f-173bad742e0b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.747990 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f980-0ba8-4ad8-8b7f-173bad742e0b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.747990 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f980-0ba8-4ad8-8b7f-173bad742e0b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.753469 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 465/928] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:06.754741 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b146ad-4dba-4f04-a101-7c7da689070d None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:06.755180 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b146ad-4dba-4f04-a101-7c7da689070d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:06.755346 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b146ad-4dba-4f04-a101-7c7da689070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:06.780772 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-53b146ad-4dba-4f04-a101-7c7da689070d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:06.782126 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-53b146ad-4dba-4f04-a101-7c7da689070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:06.870128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 464/929] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:07.239545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715dd76-6481-4261-a4a7-1ec4d681c6cc None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.239988 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715dd76-6481-4261-a4a7-1ec4d681c6cc None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.240328 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715dd76-6481-4261-a4a7-1ec4d681c6cc None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.242274 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 466/930] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 17 16:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:07.249142 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438e34-6d86-4d1e-a869-0472223cb66a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.249365 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438e34-6d86-4d1e-a869-0472223cb66a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.249654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15438e34-6d86-4d1e-a869-0472223cb66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.324665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-15438e34-6d86-4d1e-a869-0472223cb66a None None] MFA Rules not processed for user `30a70853ec1d420b9533cf1d056e170b`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:07.325887 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-15438e34-6d86-4d1e-a869-0472223cb66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:07.386641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 465/931] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 17 16:07:07 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:07:07.395665 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715dd76-6481-4261-a4a7-1ec4d681c6cc None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:07.407241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715dd76-6481-4261-a4a7-1ec4d681c6cc None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:07.410667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb693e-e201-4757-90d4-250c83e047e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:07.411248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb693e-e201-4757-90d4-250c83e047e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:07.411524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb693e-e201-4757-90d4-250c83e047e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:07.411791 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb693e-e201-4757-90d4-250c83e047e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:07.420555 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb693e-e201-4757-90d4-250c83e047e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:07.422000 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb693e-e201-4757-90d4-250c83e047e1 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:07.431307 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 467/932] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:09.886989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0aa9-b0b6-499a-8236-79d0d6ca8503 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:09.887515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0aa9-b0b6-499a-8236-79d0d6ca8503 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:09.887738 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e0aa9-b0b6-499a-8236-79d0d6ca8503 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:09.889119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 466/933] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:09.894302 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd36c6-0c38-4df3-9fda-61bb9308c51e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:09.894724 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd36c6-0c38-4df3-9fda-61bb9308c51e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:09.894845 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd36c6-0c38-4df3-9fda-61bb9308c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:09.915332 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0afd36c6-0c38-4df3-9fda-61bb9308c51e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:09.916528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0afd36c6-0c38-4df3-9fda-61bb9308c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:09.924266 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 468/934] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:10.267868 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0aa9-b0b6-499a-8236-79d0d6ca8503 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:10.279618 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e0aa9-b0b6-499a-8236-79d0d6ca8503 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:10.282921 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d727c7e-d753-48ff-a108-00c3d3b400d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:10.283636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727c7e-d753-48ff-a108-00c3d3b400d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:10.283910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727c7e-d753-48ff-a108-00c3d3b400d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:10.284175 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d727c7e-d753-48ff-a108-00c3d3b400d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:10.295236 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d727c7e-d753-48ff-a108-00c3d3b400d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:10.297100 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d727c7e-d753-48ff-a108-00c3d3b400d1 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:10.308409 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 467/935] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:07:12.853785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f6b79-9b01-4dc6-9489-4f5642458618 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.854355 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f6b79-9b01-4dc6-9489-4f5642458618 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.854612 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f6b79-9b01-4dc6-9489-4f5642458618 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.856060 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 469/936] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:12.861118 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bacf14-d7ac-443f-a085-31577182c33c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:12.861553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bacf14-d7ac-443f-a085-31577182c33c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:12.861746 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bacf14-d7ac-443f-a085-31577182c33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:12.900957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-85bacf14-d7ac-443f-a085-31577182c33c None None] MFA Rules not processed for user `7541cbe0e8d54163bc5b518d916e8367`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:12.902425 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-85bacf14-d7ac-443f-a085-31577182c33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:12.943337 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:12.984535 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 468/937] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:12 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:13.345292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951104ba-255b-48bd-9862-e6d5ac9bc2e0 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:13.345781 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951104ba-255b-48bd-9862-e6d5ac9bc2e0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:13.346158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951104ba-255b-48bd-9862-e6d5ac9bc2e0 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:13.347748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 470/938] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 17 16:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:13.355387 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da7b8-3f33-4dec-8381-0d7b2864036a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:13.355667 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da7b8-3f33-4dec-8381-0d7b2864036a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:13.355941 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29da7b8-3f33-4dec-8381-0d7b2864036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:13.375361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-f29da7b8-3f33-4dec-8381-0d7b2864036a None None] MFA Rules not processed for user `30a70853ec1d420b9533cf1d056e170b`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:13.376549 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f29da7b8-3f33-4dec-8381-0d7b2864036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:13.383201 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 469/939] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 17 16:07:13 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:13.392865 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951104ba-255b-48bd-9862-e6d5ac9bc2e0 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:13.405015 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951104ba-255b-48bd-9862-e6d5ac9bc2e0 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:13.408650 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1945a9fb-8636-4371-abcd-c08c786cf8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:13.409377 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a9fb-8636-4371-abcd-c08c786cf8ae service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:13.409787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a9fb-8636-4371-abcd-c08c786cf8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:13.410166 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1945a9fb-8636-4371-abcd-c08c786cf8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:13.420368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945a9fb-8636-4371-abcd-c08c786cf8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:13.421969 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1945a9fb-8636-4371-abcd-c08c786cf8ae service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:13.432687 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 471/940] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:13 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:16.630383 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db84f24-7fba-4f32-9f2d-cf147f3ada49 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:16.631519 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db84f24-7fba-4f32-9f2d-cf147f3ada49 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:16.631519 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db84f24-7fba-4f32-9f2d-cf147f3ada49 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:16.632963 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 470/941] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:16.638241 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f2def-d13c-4624-a4cc-1fc576aa35ca None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:16.638658 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f2def-d13c-4624-a4cc-1fc576aa35ca None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:16.638804 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f2def-d13c-4624-a4cc-1fc576aa35ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:16.657703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7a7f2def-d13c-4624-a4cc-1fc576aa35ca None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:16.658884 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7a7f2def-d13c-4624-a4cc-1fc576aa35ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:16.726452 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 472/942] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:16 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:17.075434 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db84f24-7fba-4f32-9f2d-cf147f3ada49 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:17.088026 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db84f24-7fba-4f32-9f2d-cf147f3ada49 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:17.091386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea7033-9598-432f-87b3-64d28235909e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:17.091961 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7033-9598-432f-87b3-64d28235909e service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:17.092230 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7033-9598-432f-87b3-64d28235909e service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:17.092492 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7033-9598-432f-87b3-64d28235909e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:17.101597 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea7033-9598-432f-87b3-64d28235909e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:17.103093 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea7033-9598-432f-87b3-64d28235909e service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:17.112147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 471/943] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:17 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:19.973890 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4050bb8-32c1-45bc-8ed9-1f7abf19c489 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:19.974489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4050bb8-32c1-45bc-8ed9-1f7abf19c489 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:19.974489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4050bb8-32c1-45bc-8ed9-1f7abf19c489 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:19.975870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 473/944] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:19.981220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf50e1-3bf1-4688-8f49-dc0323220563 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:19.981688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf50e1-3bf1-4688-8f49-dc0323220563 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:19.981859 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaf50e1-3bf1-4688-8f49-dc0323220563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:20.000902 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ffaf50e1-3bf1-4688-8f49-dc0323220563 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:20.002125 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ffaf50e1-3bf1-4688-8f49-dc0323220563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:20.010649 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 472/945] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:20.356952 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4050bb8-32c1-45bc-8ed9-1f7abf19c489 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:20.368956 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4050bb8-32c1-45bc-8ed9-1f7abf19c489 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:20.372393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d120fa-0e4a-4d2c-8684-2edede1111b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:20.372973 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d120fa-0e4a-4d2c-8684-2edede1111b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:20.373244 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d120fa-0e4a-4d2c-8684-2edede1111b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:20.373547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d120fa-0e4a-4d2c-8684-2edede1111b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:20.383388 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d120fa-0e4a-4d2c-8684-2edede1111b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:20.384797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d120fa-0e4a-4d2c-8684-2edede1111b2 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:20.394607 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 474/946] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:22.633751 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8cc16-1c03-495f-9e7a-48a0ce731ac3 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:22.634317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8cc16-1c03-495f-9e7a-48a0ce731ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:22.634317 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea8cc16-1c03-495f-9e7a-48a0ce731ac3 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:22.635601 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 473/947] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:22.640633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44236a-82da-4721-aab9-cefb0e7f5209 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:22.641053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44236a-82da-4721-aab9-cefb0e7f5209 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:22.641248 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44236a-82da-4721-aab9-cefb0e7f5209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:22.660984 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bd44236a-82da-4721-aab9-cefb0e7f5209 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:22.663129 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bd44236a-82da-4721-aab9-cefb0e7f5209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:22.670700 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 475/948] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:23.014579 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8cc16-1c03-495f-9e7a-48a0ce731ac3 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:23.025909 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea8cc16-1c03-495f-9e7a-48a0ce731ac3 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:23.029617 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc126d6-6842-4897-82d5-fbe2ace2ef60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:23.030205 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc126d6-6842-4897-82d5-fbe2ace2ef60 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:23.030503 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc126d6-6842-4897-82d5-fbe2ace2ef60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:23.030773 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc126d6-6842-4897-82d5-fbe2ace2ef60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:23.039685 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc126d6-6842-4897-82d5-fbe2ace2ef60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:23.041104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc126d6-6842-4897-82d5-fbe2ace2ef60 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:23.050477 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 474/949] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:25.276995 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576d2a-ecf7-4120-8a52-c56284908b7e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:25.277523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576d2a-ecf7-4120-8a52-c56284908b7e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:25.277523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86576d2a-ecf7-4120-8a52-c56284908b7e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:25.278809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 476/950] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:25.283806 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2abc2-4b97-4e26-9c76-57740cf17148 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:25.284183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2abc2-4b97-4e26-9c76-57740cf17148 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:25.284344 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2abc2-4b97-4e26-9c76-57740cf17148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:25.302988 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-9ad2abc2-4b97-4e26-9c76-57740cf17148 None None] MFA Rules not processed for user `7541cbe0e8d54163bc5b518d916e8367`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:25.304153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-9ad2abc2-4b97-4e26-9c76-57740cf17148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:25.311775 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 475/951] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:25 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:25.651537 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86576d2a-ecf7-4120-8a52-c56284908b7e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:25.663153 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86576d2a-ecf7-4120-8a52-c56284908b7e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:25.666566 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886c61-d596-4560-97f3-ddefa4a7633d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:25.667155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886c61-d596-4560-97f3-ddefa4a7633d service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:25.667426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886c61-d596-4560-97f3-ddefa4a7633d service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:25.667689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886c61-d596-4560-97f3-ddefa4a7633d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:25.677738 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886c61-d596-4560-97f3-ddefa4a7633d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:25.679540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886c61-d596-4560-97f3-ddefa4a7633d service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:25.690492 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 477/952] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:25 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:28.123819 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061df28-9e35-44c7-a523-2a3a4c6bd8a7 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:28.124334 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061df28-9e35-44c7-a523-2a3a4c6bd8a7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:28.124334 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061df28-9e35-44c7-a523-2a3a4c6bd8a7 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:28.125692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 476/953] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:28.131641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13752-74c6-4d55-a7e7-0ad8cc35e613 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:28.132051 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13752-74c6-4d55-a7e7-0ad8cc35e613 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:28.132167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13752-74c6-4d55-a7e7-0ad8cc35e613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:28.152896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-23d13752-74c6-4d55-a7e7-0ad8cc35e613 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:28.154124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-23d13752-74c6-4d55-a7e7-0ad8cc35e613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:28.161747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 478/954] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:28.507648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061df28-9e35-44c7-a523-2a3a4c6bd8a7 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:28.518163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061df28-9e35-44c7-a523-2a3a4c6bd8a7 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:28.522381 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a3685a-1e80-4bba-948a-2251147cc65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:28.522970 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3685a-1e80-4bba-948a-2251147cc65f service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:28.523246 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3685a-1e80-4bba-948a-2251147cc65f service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:28.523513 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a3685a-1e80-4bba-948a-2251147cc65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:28.532676 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3685a-1e80-4bba-948a-2251147cc65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:28.534128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a3685a-1e80-4bba-948a-2251147cc65f service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:28.545605 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 477/955] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:30.810892 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beea59b-ed90-48cc-b35f-c785fbb3ec8b None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:30.811417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beea59b-ed90-48cc-b35f-c785fbb3ec8b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:30.811417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beea59b-ed90-48cc-b35f-c785fbb3ec8b None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:30.812664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 479/956] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:30.817923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf75b5-ae64-4d1f-89b0-604153318b44 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:30.818463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf75b5-ae64-4d1f-89b0-604153318b44 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:30.818575 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf75b5-ae64-4d1f-89b0-604153318b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:30.837895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-9caf75b5-ae64-4d1f-89b0-604153318b44 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:30.839075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-9caf75b5-ae64-4d1f-89b0-604153318b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:30.846791 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 478/957] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:31.196730 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beea59b-ed90-48cc-b35f-c785fbb3ec8b None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:31.207170 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beea59b-ed90-48cc-b35f-c785fbb3ec8b None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:31.210657 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f648d5-0e10-44ce-9650-577b2311ef5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:31.211229 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f648d5-0e10-44ce-9650-577b2311ef5d service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:31.211501 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f648d5-0e10-44ce-9650-577b2311ef5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:31.211764 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f648d5-0e10-44ce-9650-577b2311ef5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:31.220342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f648d5-0e10-44ce-9650-577b2311ef5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:31.221792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f648d5-0e10-44ce-9650-577b2311ef5d service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:31.231601 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 480/958] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:33.935626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41263c9-9bf4-42cd-ae6d-76c1c2d592a4 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:33.936153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41263c9-9bf4-42cd-ae6d-76c1c2d592a4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:33.936153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41263c9-9bf4-42cd-ae6d-76c1c2d592a4 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:33.937543 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 479/959] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:33.942937 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3887522-8d3e-41ed-a1ea-ec3fcaafcf7d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:33.943362 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3887522-8d3e-41ed-a1ea-ec3fcaafcf7d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:33.943520 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3887522-8d3e-41ed-a1ea-ec3fcaafcf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:33.962788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d3887522-8d3e-41ed-a1ea-ec3fcaafcf7d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:33.963960 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d3887522-8d3e-41ed-a1ea-ec3fcaafcf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:33.971547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 481/960] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:33 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:34.320879 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41263c9-9bf4-42cd-ae6d-76c1c2d592a4 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:34.331338 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41263c9-9bf4-42cd-ae6d-76c1c2d592a4 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:34.335431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f89410-3a87-43ef-b1fc-a6ec9bd45300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:34.336011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f89410-3a87-43ef-b1fc-a6ec9bd45300 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:34.336285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f89410-3a87-43ef-b1fc-a6ec9bd45300 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:34.336550 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f89410-3a87-43ef-b1fc-a6ec9bd45300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:34.345309 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f89410-3a87-43ef-b1fc-a6ec9bd45300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:34.346772 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f89410-3a87-43ef-b1fc-a6ec9bd45300 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:34.356081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 480/961] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:34 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:38.754208 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a9ae-573d-4bb7-bce2-1a9a4b12aeac None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:38.755245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a9ae-573d-4bb7-bce2-1a9a4b12aeac None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:38.755331 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7a9ae-573d-4bb7-bce2-1a9a4b12aeac None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:38.757134 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 482/962] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:38.762388 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c10751-75c6-4dcd-9260-b0f6280f2206 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:38.762825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c10751-75c6-4dcd-9260-b0f6280f2206 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:38.762915 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c10751-75c6-4dcd-9260-b0f6280f2206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:38.782764 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c2c10751-75c6-4dcd-9260-b0f6280f2206 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:38.783863 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c2c10751-75c6-4dcd-9260-b0f6280f2206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:38.791878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 481/963] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:39.134370 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7a9ae-573d-4bb7-bce2-1a9a4b12aeac None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:39.139807 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=74 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:39.146978 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7a9ae-573d-4bb7-bce2-1a9a4b12aeac None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:39.150474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957987-e9ef-4520-aca2-1b7144bd13f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:39.151314 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957987-e9ef-4520-aca2-1b7144bd13f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:39.151587 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957987-e9ef-4520-aca2-1b7144bd13f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:39.151853 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957987-e9ef-4520-aca2-1b7144bd13f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:39.161494 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957987-e9ef-4520-aca2-1b7144bd13f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:39.163180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957987-e9ef-4520-aca2-1b7144bd13f8 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:39.172783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 483/964] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:42.009281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead635a8-1e29-4675-b144-9ab51b11e74e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:42.009845 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead635a8-1e29-4675-b144-9ab51b11e74e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:42.009845 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead635a8-1e29-4675-b144-9ab51b11e74e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:42.011178 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 482/965] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:42.016416 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b6db9-689b-42f2-9eab-146f0bee8d46 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:42.016851 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b6db9-689b-42f2-9eab-146f0bee8d46 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:42.016950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b6db9-689b-42f2-9eab-146f0bee8d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:42.036626 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-9b4b6db9-689b-42f2-9eab-146f0bee8d46 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:42.037871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-9b4b6db9-689b-42f2-9eab-146f0bee8d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:42.045847 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 484/966] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:42 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:42.386378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead635a8-1e29-4675-b144-9ab51b11e74e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:42.397484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead635a8-1e29-4675-b144-9ab51b11e74e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:42.401163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0b775-590b-41e6-ad44-16fa744e46cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:42.401772 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b775-590b-41e6-ad44-16fa744e46cf service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:42.402044 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b775-590b-41e6-ad44-16fa744e46cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:42.402309 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0b775-590b-41e6-ad44-16fa744e46cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:42.410813 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0b775-590b-41e6-ad44-16fa744e46cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:42.412209 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0b775-590b-41e6-ad44-16fa744e46cf service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:42.421533 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 483/967] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:42 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:46.876616 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081018c4-4163-464b-966a-e85d60a012a8 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:46.877135 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081018c4-4163-464b-966a-e85d60a012a8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:46.877135 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081018c4-4163-464b-966a-e85d60a012a8 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:46.878447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 485/968] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:46.884255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002216-2b7f-4f35-a857-a99e65ed3691 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:46.884672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002216-2b7f-4f35-a857-a99e65ed3691 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:46.884798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c002216-2b7f-4f35-a857-a99e65ed3691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:46.892011 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=57 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:46.906204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-6c002216-2b7f-4f35-a857-a99e65ed3691 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:46.907387 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-6c002216-2b7f-4f35-a857-a99e65ed3691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:46.915165 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 484/969] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:07:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:47.259366 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081018c4-4163-464b-966a-e85d60a012a8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:07:47.270275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081018c4-4163-464b-966a-e85d60a012a8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:07:47.273702 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e75ac-0e0e-42c0-8fcf-ec6184520537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:07:47.274281 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e75ac-0e0e-42c0-8fcf-ec6184520537 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:47.274551 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e75ac-0e0e-42c0-8fcf-ec6184520537 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:47.274816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e75ac-0e0e-42c0-8fcf-ec6184520537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:47.283704 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e75ac-0e0e-42c0-8fcf-ec6184520537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:07:47.285444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e75ac-0e0e-42c0-8fcf-ec6184520537 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:07:47.294902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 486/970] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:07:47 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:07:52.767291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408559a-52fc-404f-853e-e2067a309fd9 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:52.767744 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408559a-52fc-404f-853e-e2067a309fd9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:52.767832 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408559a-52fc-404f-853e-e2067a309fd9 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:52.772955 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 485/971] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 17 16:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:52.774249 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39729eb-7153-4389-bcff-e10c6d04b813 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:52.775065 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39729eb-7153-4389-bcff-e10c6d04b813 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:52.775806 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39729eb-7153-4389-bcff-e10c6d04b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:52.864971 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a39729eb-7153-4389-bcff-e10c6d04b813 None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:52.870876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a39729eb-7153-4389-bcff-e10c6d04b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:52.963372 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 487/972] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 17 16:07:52 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:07:56.901475 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=2 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:07:57.594818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104011f-9194-4a51-ad42-117a0602d6f3 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:57.595217 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104011f-9194-4a51-ad42-117a0602d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:57.595431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104011f-9194-4a51-ad42-117a0602d6f3 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:57.597085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 486/973] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 17 16:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:57.603239 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb28f-ac08-4764-b00c-a340f1020d89 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:57.603808 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb28f-ac08-4764-b00c-a340f1020d89 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:57.604050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fb28f-ac08-4764-b00c-a340f1020d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:57.625554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-360fb28f-ac08-4764-b00c-a340f1020d89 None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:57.626720 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-360fb28f-ac08-4764-b00c-a340f1020d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:57.636483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 488/974] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 17 16:07:57 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:07:59.211616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af369f-d5f8-40c7-8207-a383bf132d36 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.212133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af369f-d5f8-40c7-8207-a383bf132d36 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.212389 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af369f-d5f8-40c7-8207-a383bf132d36 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.213761 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 487/975] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 17 16:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:07:59.219040 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1a1c-4b55-48df-b093-ce20c82e4fb5 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:07:59.219460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1a1c-4b55-48df-b093-ce20c82e4fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:07:59.219588 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12db1a1c-4b55-48df-b093-ce20c82e4fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:07:59.241578 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-12db1a1c-4b55-48df-b093-ce20c82e4fb5 None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:07:59.242736 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-12db1a1c-4b55-48df-b093-ce20c82e4fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:07:59.251412 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 489/976] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 17 16:07:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:03.093856 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaeddb-da67-43e8-bf18-b0d18d006f52 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:03.094376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaeddb-da67-43e8-bf18-b0d18d006f52 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:03.094376 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaeddb-da67-43e8-bf18-b0d18d006f52 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:03.095834 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 488/977] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:03.101432 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0967f21-5e54-4a84-8f2c-eb32bc26359a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:03.101831 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0967f21-5e54-4a84-8f2c-eb32bc26359a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:03.101973 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0967f21-5e54-4a84-8f2c-eb32bc26359a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:03.121957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b0967f21-5e54-4a84-8f2c-eb32bc26359a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:03.123450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b0967f21-5e54-4a84-8f2c-eb32bc26359a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:03.131393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 490/978] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:03.496525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3af17-7ff7-456f-adcc-5d8290417a51 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:03.497415 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3af17-7ff7-456f-adcc-5d8290417a51 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:03.498079 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3af17-7ff7-456f-adcc-5d8290417a51 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:03.500736 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 489/979] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 17 16:08:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:03.510010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04ae9-a68d-4905-ae12-5723327d3258 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:03.511319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04ae9-a68d-4905-ae12-5723327d3258 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:03.512094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc04ae9-a68d-4905-ae12-5723327d3258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:03.557448 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bfc04ae9-a68d-4905-ae12-5723327d3258 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:03.558811 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bfc04ae9-a68d-4905-ae12-5723327d3258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:03.640255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:03.646565 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 491/980] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 17 16:08:03 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:08:03.654183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3af17-7ff7-456f-adcc-5d8290417a51 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:03.668294 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3af17-7ff7-456f-adcc-5d8290417a51 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:03.673532 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f69ac3-10e1-44a9-846d-4ea8b4c41a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:03.674247 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69ac3-10e1-44a9-846d-4ea8b4c41a7d service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:03.674532 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69ac3-10e1-44a9-846d-4ea8b4c41a7d service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:03.675354 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f69ac3-10e1-44a9-846d-4ea8b4c41a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:03.684300 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f69ac3-10e1-44a9-846d-4ea8b4c41a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:03.685966 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f69ac3-10e1-44a9-846d-4ea8b4c41a7d service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:03.699393 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 490/981] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:06.148329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cc6a-b2c9-4a60-be53-d0cef73f4c97 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:06.148846 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cc6a-b2c9-4a60-be53-d0cef73f4c97 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:06.148846 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9cc6a-b2c9-4a60-be53-d0cef73f4c97 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:06.150657 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 492/982] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:06.155769 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545449a2-3846-4fc4-8190-3088d883c443 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:06.156204 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545449a2-3846-4fc4-8190-3088d883c443 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:06.156315 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545449a2-3846-4fc4-8190-3088d883c443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:06.181135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-545449a2-3846-4fc4-8190-3088d883c443 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:06.182586 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-545449a2-3846-4fc4-8190-3088d883c443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:06.192457 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 491/983] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:06.538942 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cc6a-b2c9-4a60-be53-d0cef73f4c97 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:06.554474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9cc6a-b2c9-4a60-be53-d0cef73f4c97 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:06.559485 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e525-11b5-4f6e-81e3-aa203f1aaae1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:06.560253 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e525-11b5-4f6e-81e3-aa203f1aaae1 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:06.560627 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e525-11b5-4f6e-81e3-aa203f1aaae1 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:06.560998 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e525-11b5-4f6e-81e3-aa203f1aaae1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:06.570764 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e525-11b5-4f6e-81e3-aa203f1aaae1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:06.572478 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e525-11b5-4f6e-81e3-aa203f1aaae1 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:06.582789 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 493/984] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:09.131101 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da930594-7b38-4858-871d-575eb5be0b41 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:09.131614 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da930594-7b38-4858-871d-575eb5be0b41 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:09.131724 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da930594-7b38-4858-871d-575eb5be0b41 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:09.132979 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 492/985] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:09.138266 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bd98a-e273-4f94-9907-27555bb5d230 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:09.138670 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bd98a-e273-4f94-9907-27555bb5d230 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:09.139022 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bd98a-e273-4f94-9907-27555bb5d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:09.158401 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-832bd98a-e273-4f94-9907-27555bb5d230 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:09.160373 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-832bd98a-e273-4f94-9907-27555bb5d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:09.168202 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 494/986] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:09.528334 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f87b-699c-4610-81c6-1e25761f331c None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:09.528688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f87b-699c-4610-81c6-1e25761f331c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:09.528884 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb7f87b-699c-4610-81c6-1e25761f331c None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:09.530254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 493/987] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 17 16:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:09.536416 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa841d-f5e2-4d26-96a1-e045ec7eade9 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:09.536701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa841d-f5e2-4d26-96a1-e045ec7eade9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:09.536975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa841d-f5e2-4d26-96a1-e045ec7eade9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:09.559581 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-65aa841d-f5e2-4d26-96a1-e045ec7eade9 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:09.560876 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-65aa841d-f5e2-4d26-96a1-e045ec7eade9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:09.571385 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 495/988] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 17 16:08:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:08:09.579391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f87b-699c-4610-81c6-1e25761f331c None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:09.601110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb7f87b-699c-4610-81c6-1e25761f331c None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:09.608015 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d45164-68e7-4112-8c4a-d4fda9650f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:09.608619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45164-68e7-4112-8c4a-d4fda9650f58 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:09.608894 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45164-68e7-4112-8c4a-d4fda9650f58 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:09.609160 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d45164-68e7-4112-8c4a-d4fda9650f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:09.619398 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45164-68e7-4112-8c4a-d4fda9650f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:09.621213 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d45164-68e7-4112-8c4a-d4fda9650f58 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:09.632414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 494/989] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:12.047032 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af421c1-df39-47c0-a2af-e640d60b7184 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:12.048087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af421c1-df39-47c0-a2af-e640d60b7184 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:12.048532 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af421c1-df39-47c0-a2af-e640d60b7184 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:12.055075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 496/990] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:12.056628 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce11d-915c-438f-a3d6-5a1d780e3d48 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:12.057074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce11d-915c-438f-a3d6-5a1d780e3d48 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:12.057386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce11d-915c-438f-a3d6-5a1d780e3d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:12.076692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a69ce11d-915c-438f-a3d6-5a1d780e3d48 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:12.078348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a69ce11d-915c-438f-a3d6-5a1d780e3d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:12.087132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 495/991] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:12.459941 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af421c1-df39-47c0-a2af-e640d60b7184 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:12.475778 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af421c1-df39-47c0-a2af-e640d60b7184 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:12.481459 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050d32c-3786-407c-8a96-bd1627e05d3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:12.482269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050d32c-3786-407c-8a96-bd1627e05d3c service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:12.482700 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050d32c-3786-407c-8a96-bd1627e05d3c service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:12.483233 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050d32c-3786-407c-8a96-bd1627e05d3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:12.493370 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050d32c-3786-407c-8a96-bd1627e05d3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:12.495196 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050d32c-3786-407c-8a96-bd1627e05d3c service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:12.506466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 497/992] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:13.664443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb9b1-3dfe-4413-bf84-04ff3a09eb70 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:13.665774 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb9b1-3dfe-4413-bf84-04ff3a09eb70 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:13.666330 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb9b1-3dfe-4413-bf84-04ff3a09eb70 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:13.669397 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 496/993] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:13.673879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590532-9515-4e35-8f58-b4dba34ebd4b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:13.674947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590532-9515-4e35-8f58-b4dba34ebd4b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:13.675046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590532-9515-4e35-8f58-b4dba34ebd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:13.697971 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f3590532-9515-4e35-8f58-b4dba34ebd4b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:13.699186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f3590532-9515-4e35-8f58-b4dba34ebd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:13.709730 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 498/994] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:14.334510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1bd9f-3087-4eec-bfc6-2502bc1fc5e9 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:14.334510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1bd9f-3087-4eec-bfc6-2502bc1fc5e9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:14.334864 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1bd9f-3087-4eec-bfc6-2502bc1fc5e9 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:14.336347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 497/995] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 17 16:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:14.341574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094edde-ade4-415c-9de4-f8946ccd9253 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:14.341925 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094edde-ade4-415c-9de4-f8946ccd9253 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:14.342690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094edde-ade4-415c-9de4-f8946ccd9253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:14.383467 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-1094edde-ade4-415c-9de4-f8946ccd9253 None None] MFA Rules not processed for user `738338255eae424ebc3ab73e2cf6b203`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:14.385081 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-1094edde-ade4-415c-9de4-f8946ccd9253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:14.448342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 499/996] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 17 16:08:14 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:14.455817 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1bd9f-3087-4eec-bfc6-2502bc1fc5e9 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:14.467211 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1bd9f-3087-4eec-bfc6-2502bc1fc5e9 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:14.471836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3107d3-2631-498f-963e-7f1fbb4cd69a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738338255eae424ebc3ab73e2cf6b203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:14.472529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3107d3-2631-498f-963e-7f1fbb4cd69a service cinder] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:14.472878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3107d3-2631-498f-963e-7f1fbb4cd69a service cinder] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:14.473224 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3107d3-2631-498f-963e-7f1fbb4cd69a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:14.483573 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3107d3-2631-498f-963e-7f1fbb4cd69a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:14.485348 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3107d3-2631-498f-963e-7f1fbb4cd69a service cinder] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:14.496867 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 498/997] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:08:14.983463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97b0b-0a55-43e7-9e4c-07353e1f4098 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:14.983463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97b0b-0a55-43e7-9e4c-07353e1f4098 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:14.983463 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae97b0b-0a55-43e7-9e4c-07353e1f4098 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:14.984491 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 500/998] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:14.990637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be03f-bf2e-43e6-ad4a-a40c8fbf15e8 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:14.991047 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be03f-bf2e-43e6-ad4a-a40c8fbf15e8 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:14.991170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41be03f-bf2e-43e6-ad4a-a40c8fbf15e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:15.010696 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-f41be03f-bf2e-43e6-ad4a-a40c8fbf15e8 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:15.011875 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f41be03f-bf2e-43e6-ad4a-a40c8fbf15e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:15.020296 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 499/999] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:15.370310 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97b0b-0a55-43e7-9e4c-07353e1f4098 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:15.385489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae97b0b-0a55-43e7-9e4c-07353e1f4098 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:15.391963 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2d6e5-e23a-4e26-86a1-74d49d66c2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:15.392675 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d6e5-e23a-4e26-86a1-74d49d66c2cb service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:15.393710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d6e5-e23a-4e26-86a1-74d49d66c2cb service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:15.394275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2d6e5-e23a-4e26-86a1-74d49d66c2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:15.404379 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2d6e5-e23a-4e26-86a1-74d49d66c2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:15.406507 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2d6e5-e23a-4e26-86a1-74d49d66c2cb service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:15.423617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 501/1000] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:17.673637 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d6ec-bf63-4699-a5a6-be0e74b31f11 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:17.674777 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d6ec-bf63-4699-a5a6-be0e74b31f11 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:17.674777 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083d6ec-bf63-4699-a5a6-be0e74b31f11 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:17.676090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 500/1001] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:17.681523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95f696-e7f8-4e8d-9146-7bba8111b8a6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:17.681935 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95f696-e7f8-4e8d-9146-7bba8111b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:17.682124 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95f696-e7f8-4e8d-9146-7bba8111b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:17.701066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-3a95f696-e7f8-4e8d-9146-7bba8111b8a6 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:17.702261 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3a95f696-e7f8-4e8d-9146-7bba8111b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:17.710579 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 502/1002] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:18.060135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083d6ec-bf63-4699-a5a6-be0e74b31f11 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:18.074200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083d6ec-bf63-4699-a5a6-be0e74b31f11 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:18.079025 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06b5e6-8f41-407b-8ac0-f2a223e0ecb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:18.079612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b5e6-8f41-407b-8ac0-f2a223e0ecb1 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:18.079882 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b5e6-8f41-407b-8ac0-f2a223e0ecb1 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:18.080188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06b5e6-8f41-407b-8ac0-f2a223e0ecb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:18.089228 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06b5e6-8f41-407b-8ac0-f2a223e0ecb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:18.090850 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06b5e6-8f41-407b-8ac0-f2a223e0ecb1 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:18.100828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 501/1003] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:20.370449 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8897-0634-44ce-9ce8-14bde4ce2a16 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:20.371026 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8897-0634-44ce-9ce8-14bde4ce2a16 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:20.371026 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea8897-0634-44ce-9ce8-14bde4ce2a16 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:20.372305 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 503/1004] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:20.378283 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecfab-7409-4142-a3d0-9774af36554a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:20.378739 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecfab-7409-4142-a3d0-9774af36554a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:20.378837 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ecfab-7409-4142-a3d0-9774af36554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:20.399105 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b29ecfab-7409-4142-a3d0-9774af36554a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:20.400640 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b29ecfab-7409-4142-a3d0-9774af36554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:20.409095 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 502/1005] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:20 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:20.760275 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8897-0634-44ce-9ce8-14bde4ce2a16 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:20.775033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea8897-0634-44ce-9ce8-14bde4ce2a16 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:20.780060 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb97350-c760-425a-aa87-81072b3f90ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:20.780655 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97350-c760-425a-aa87-81072b3f90ab service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:20.780934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97350-c760-425a-aa87-81072b3f90ab service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:20.781199 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb97350-c760-425a-aa87-81072b3f90ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:20.790574 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb97350-c760-425a-aa87-81072b3f90ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:20.792143 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb97350-c760-425a-aa87-81072b3f90ab service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:20.802446 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 504/1006] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:23.065911 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeac240-d137-42bd-9d91-290abbfc4681 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:23.066435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeac240-d137-42bd-9d91-290abbfc4681 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:23.066545 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeac240-d137-42bd-9d91-290abbfc4681 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:23.068244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 503/1007] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:23.073932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ac79-9533-4458-acaa-de3dcbfcb0eb None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:23.074376 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ac79-9533-4458-acaa-de3dcbfcb0eb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:23.074470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36ac79-9533-4458-acaa-de3dcbfcb0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:23.094213 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0b36ac79-9533-4458-acaa-de3dcbfcb0eb None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:23.095413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0b36ac79-9533-4458-acaa-de3dcbfcb0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:23.103942 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 505/1008] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:23.454229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeac240-d137-42bd-9d91-290abbfc4681 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:23.471427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeac240-d137-42bd-9d91-290abbfc4681 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:23.479055 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cc837-e6e7-43e3-a7fb-6a4cb247f609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:23.479648 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc837-e6e7-43e3-a7fb-6a4cb247f609 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:23.479920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc837-e6e7-43e3-a7fb-6a4cb247f609 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:23.480183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc837-e6e7-43e3-a7fb-6a4cb247f609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:23.489916 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cc837-e6e7-43e3-a7fb-6a4cb247f609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:23.491563 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cc837-e6e7-43e3-a7fb-6a4cb247f609 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:23.504043 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 504/1009] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:08:25.842639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac9782-ff56-47b1-bffc-b3f9f21addb9 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:25.843402 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac9782-ff56-47b1-bffc-b3f9f21addb9 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:25.843402 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac9782-ff56-47b1-bffc-b3f9f21addb9 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:25.844471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 506/1010] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:08:25.851641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f30c-649c-48a2-ae9c-beb36e099cf6 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:25.852179 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f30c-649c-48a2-ae9c-beb36e099cf6 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:25.852362 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91f30c-649c-48a2-ae9c-beb36e099cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:25.874631 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2d91f30c-649c-48a2-ae9c-beb36e099cf6 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:25.875811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2d91f30c-649c-48a2-ae9c-beb36e099cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:25.883873 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 505/1011] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:26.246512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac9782-ff56-47b1-bffc-b3f9f21addb9 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:26.261690 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac9782-ff56-47b1-bffc-b3f9f21addb9 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:26.267153 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0dff7-b424-4d01-89d4-a7f8565b79eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:26.268346 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0dff7-b424-4d01-89d4-a7f8565b79eb service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:26.268617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0dff7-b424-4d01-89d4-a7f8565b79eb service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:26.268882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0dff7-b424-4d01-89d4-a7f8565b79eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:26.277983 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0dff7-b424-4d01-89d4-a7f8565b79eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:26.279576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0dff7-b424-4d01-89d4-a7f8565b79eb service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:26.289220 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 507/1012] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:08:29.257776 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5698f-94c2-4c19-b3d7-bb64b5f2fccf None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:29.258381 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5698f-94c2-4c19-b3d7-bb64b5f2fccf None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:29.258381 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5698f-94c2-4c19-b3d7-bb64b5f2fccf None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:29.259681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 506/1013] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:29.264902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a16c4-46db-4656-b9e3-189ca0d770bd None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:29.265407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a16c4-46db-4656-b9e3-189ca0d770bd None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:29.265518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a16c4-46db-4656-b9e3-189ca0d770bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:29.286556 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-793a16c4-46db-4656-b9e3-189ca0d770bd None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:29.287745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-793a16c4-46db-4656-b9e3-189ca0d770bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:29.295825 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 508/1014] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:29.651755 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5698f-94c2-4c19-b3d7-bb64b5f2fccf None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:29.659554 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=46 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:29.666589 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5698f-94c2-4c19-b3d7-bb64b5f2fccf None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:29.671502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057dc5a1-4b04-43e6-838e-c1fdf0cc3555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:29.672081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc5a1-4b04-43e6-838e-c1fdf0cc3555 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:29.672357 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc5a1-4b04-43e6-838e-c1fdf0cc3555 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:29.672619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057dc5a1-4b04-43e6-838e-c1fdf0cc3555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:29.686671 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dc5a1-4b04-43e6-838e-c1fdf0cc3555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:29.688244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057dc5a1-4b04-43e6-838e-c1fdf0cc3555 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:29.699525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 507/1015] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:30.682734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44905f-cc94-4633-bdbd-7428e4c59ecf None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:30.683273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44905f-cc94-4633-bdbd-7428e4c59ecf None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:30.683273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44905f-cc94-4633-bdbd-7428e4c59ecf None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:30.684601 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 509/1016] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:30.690483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1ef0-ab36-466f-9799-f190718404b4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:30.690899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1ef0-ab36-466f-9799-f190718404b4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:30.691034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce1ef0-ab36-466f-9799-f190718404b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:30.710170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-f4ce1ef0-ab36-466f-9799-f190718404b4 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:30.711350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f4ce1ef0-ab36-466f-9799-f190718404b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:30.719351 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 508/1017] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:31.081070 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a854a-bdf5-407c-b372-413ae3efeda4 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.081371 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a854a-bdf5-407c-b372-413ae3efeda4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.081641 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a854a-bdf5-407c-b372-413ae3efeda4 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.082947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 510/1018] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 17 16:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:31.088303 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359aa72-6d96-4778-9939-c6ae3bc15104 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.088598 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359aa72-6d96-4778-9939-c6ae3bc15104 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.088858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1359aa72-6d96-4778-9939-c6ae3bc15104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.126132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1359aa72-6d96-4778-9939-c6ae3bc15104 None None] MFA Rules not processed for user `c222aec3576b436b8bfcef46f12751ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:31.128030 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1359aa72-6d96-4778-9939-c6ae3bc15104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:31.188512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 509/1019] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 17 16:08:31 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:31.196480 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a854a-bdf5-407c-b372-413ae3efeda4 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:31.207518 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a854a-bdf5-407c-b372-413ae3efeda4 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:31.211013 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4683d-6904-4f9f-aff6-df7f6b5b6e5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c222aec3576b436b8bfcef46f12751ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:31.211606 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4683d-6904-4f9f-aff6-df7f6b5b6e5e service glance] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.211874 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4683d-6904-4f9f-aff6-df7f6b5b6e5e service glance] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.212140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4683d-6904-4f9f-aff6-df7f6b5b6e5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.221465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4683d-6904-4f9f-aff6-df7f6b5b6e5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:31.222894 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4683d-6904-4f9f-aff6-df7f6b5b6e5e service glance] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:31.232363 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 511/1020] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:31.958957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994584-48ec-43c0-8be2-0474355baa51 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.959569 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994584-48ec-43c0-8be2-0474355baa51 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.959569 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994584-48ec-43c0-8be2-0474355baa51 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.960824 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 510/1021] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:08:31.966242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36def5-16c1-4fed-8aff-69c13d9bcbfd None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:31.966720 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36def5-16c1-4fed-8aff-69c13d9bcbfd None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:31.966819 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36def5-16c1-4fed-8aff-69c13d9bcbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:31.992453 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-ec36def5-16c1-4fed-8aff-69c13d9bcbfd None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:31.993725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-ec36def5-16c1-4fed-8aff-69c13d9bcbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:32.002557 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 512/1022] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:08:32.355649 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994584-48ec-43c0-8be2-0474355baa51 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:32.369250 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994584-48ec-43c0-8be2-0474355baa51 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:32.376072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208b26a-7248-421d-98b8-c48315aa0fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:32.377255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b26a-7248-421d-98b8-c48315aa0fd4 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:32.377561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b26a-7248-421d-98b8-c48315aa0fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:32.377827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b26a-7248-421d-98b8-c48315aa0fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:32.386573 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208b26a-7248-421d-98b8-c48315aa0fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:32.389877 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208b26a-7248-421d-98b8-c48315aa0fd4 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:32.399024 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 511/1023] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:34.749727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097feba-8d9e-4c92-863c-b1846a65afb0 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:34.750387 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097feba-8d9e-4c92-863c-b1846a65afb0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:34.750387 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097feba-8d9e-4c92-863c-b1846a65afb0 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:34.752403 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 513/1024] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:08:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:34.762541 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fefd-692e-4c9a-8dec-a164ecdf807b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:34.763083 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fefd-692e-4c9a-8dec-a164ecdf807b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:34.763183 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fefd-692e-4c9a-8dec-a164ecdf807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:34.784493 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ad24fefd-692e-4c9a-8dec-a164ecdf807b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:34.785852 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ad24fefd-692e-4c9a-8dec-a164ecdf807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:34.793654 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 512/1025] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:08:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:35.155167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097feba-8d9e-4c92-863c-b1846a65afb0 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:35.162947 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=92 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:35.174856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c097feba-8d9e-4c92-863c-b1846a65afb0 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:35.180183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2265b59-5ce4-4872-adc2-ab29019904d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:35.180795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2265b59-5ce4-4872-adc2-ab29019904d9 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:35.181066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2265b59-5ce4-4872-adc2-ab29019904d9 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:35.181350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2265b59-5ce4-4872-adc2-ab29019904d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:35.191858 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2265b59-5ce4-4872-adc2-ab29019904d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:35.196030 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2265b59-5ce4-4872-adc2-ab29019904d9 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:35.207218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 514/1026] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:44.778742 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=50 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:45.202400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=5 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:08:46.562744 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9156a-5fbb-4cae-b40a-3b5fb9e39225 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:46.563310 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9156a-5fbb-4cae-b40a-3b5fb9e39225 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:46.563310 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c9156a-5fbb-4cae-b40a-3b5fb9e39225 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:46.564619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 513/1027] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 17 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:46.569768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7cb8-7ad3-41c3-9f0a-1f23a312e86b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:46.570195 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7cb8-7ad3-41c3-9f0a-1f23a312e86b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:46.570309 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e7cb8-7ad3-41c3-9f0a-1f23a312e86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:46.589203 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-348e7cb8-7ad3-41c3-9f0a-1f23a312e86b None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:46.590434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-348e7cb8-7ad3-41c3-9f0a-1f23a312e86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:46.600116 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 515/1028] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 17 16:08:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:46.614610 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a44da1-e5dd-4edb-841b-9e7ac9911e32 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:46.614886 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a44da1-e5dd-4edb-841b-9e7ac9911e32 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:46.615155 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a44da1-e5dd-4edb-841b-9e7ac9911e32 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:46.616443 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 514/1029] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 17 16:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:46.620859 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99407-9233-4b9b-baac-31e496162bc6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:46.621143 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99407-9233-4b9b-baac-31e496162bc6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:46.621448 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a99407-9233-4b9b-baac-31e496162bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:46.640158 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c7a99407-9233-4b9b-baac-31e496162bc6 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:46.641361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c7a99407-9233-4b9b-baac-31e496162bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:46.650041 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 516/1030] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 17 16:08:46 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:49.293621 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30375e0e-ffcc-4404-8420-4701582cd7d2 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:49.294159 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30375e0e-ffcc-4404-8420-4701582cd7d2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:49.294159 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30375e0e-ffcc-4404-8420-4701582cd7d2 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:49.295441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:08:49.300820 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06454d-878f-4aa2-ba90-a2bf3baca4db None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:49.301269 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06454d-878f-4aa2-ba90-a2bf3baca4db None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:49.301407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06454d-878f-4aa2-ba90-a2bf3baca4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:49.320377 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bd06454d-878f-4aa2-ba90-a2bf3baca4db None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:49.321597 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bd06454d-878f-4aa2-ba90-a2bf3baca4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:49.330142 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:08:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:49.689308 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30375e0e-ffcc-4404-8420-4701582cd7d2 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:49.703454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30375e0e-ffcc-4404-8420-4701582cd7d2 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:49.708898 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb0bad-507b-4230-b36e-359ee4f6a777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:49.709543 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb0bad-507b-4230-b36e-359ee4f6a777 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:49.709818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb0bad-507b-4230-b36e-359ee4f6a777 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:49.710086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb0bad-507b-4230-b36e-359ee4f6a777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:49.718019 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb0bad-507b-4230-b36e-359ee4f6a777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:49.719690 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beb0bad-507b-4230-b36e-359ee4f6a777 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:49.728850 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 516/1033] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:50.682861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8bdd2-1b0c-46f5-827d-cae13e06aa82 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:50.683400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8bdd2-1b0c-46f5-827d-cae13e06aa82 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:50.683400 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8bdd2-1b0c-46f5-827d-cae13e06aa82 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:50.684754 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:50.690277 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13411b-2d16-4612-ae21-36a004bf2156 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:50.690730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13411b-2d16-4612-ae21-36a004bf2156 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:50.690843 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13411b-2d16-4612-ae21-36a004bf2156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:50.710057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1b13411b-2d16-4612-ae21-36a004bf2156 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:50.711228 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1b13411b-2d16-4612-ae21-36a004bf2156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:50.718725 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:50.918582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8bdd2-1b0c-46f5-827d-cae13e06aa82 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:50.932078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8bdd2-1b0c-46f5-827d-cae13e06aa82 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:50.936917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab25ec-b8e3-4022-9045-40c6346a7e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:50.937477 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab25ec-b8e3-4022-9045-40c6346a7e15 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:50.937752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab25ec-b8e3-4022-9045-40c6346a7e15 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:50.938019 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab25ec-b8e3-4022-9045-40c6346a7e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:50.947226 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab25ec-b8e3-4022-9045-40c6346a7e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:50.948801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab25ec-b8e3-4022-9045-40c6346a7e15 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:50.958907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 519/1036] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:51.879030 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f37a9-3514-4c34-9e5f-06448459b0d1 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:51.879567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f37a9-3514-4c34-9e5f-06448459b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:51.879567 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f37a9-3514-4c34-9e5f-06448459b0d1 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:51.880920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:51.885904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f1d4-a7f7-4310-a1fe-0bc03c10ff2b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:51.886342 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f1d4-a7f7-4310-a1fe-0bc03c10ff2b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:51.886479 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f1d4-a7f7-4310-a1fe-0bc03c10ff2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:51.905545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f3c9f1d4-a7f7-4310-a1fe-0bc03c10ff2b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:51.906729 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f3c9f1d4-a7f7-4310-a1fe-0bc03c10ff2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:51.914962 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:52.072646 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f37a9-3514-4c34-9e5f-06448459b0d1 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:52.086641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f37a9-3514-4c34-9e5f-06448459b0d1 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:52.091629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9390fe64-7d84-4aec-9561-d3d8c2e12164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:52.092222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390fe64-7d84-4aec-9561-d3d8c2e12164 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:52.092498 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390fe64-7d84-4aec-9561-d3d8c2e12164 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:52.092767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9390fe64-7d84-4aec-9561-d3d8c2e12164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:52.101485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390fe64-7d84-4aec-9561-d3d8c2e12164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:52.103045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9390fe64-7d84-4aec-9561-d3d8c2e12164 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:52.112240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 519/1039] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:52.982938 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1dbaa-5828-419a-9aef-4a7ca215bfd3 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:52.983512 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1dbaa-5828-419a-9aef-4a7ca215bfd3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:52.983607 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1dbaa-5828-419a-9aef-4a7ca215bfd3 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:52.985584 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:52.990603 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc0e7-d51a-472d-b607-8be2f8f41b43 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:52.991018 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc0e7-d51a-472d-b607-8be2f8f41b43 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:52.991209 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc0e7-d51a-472d-b607-8be2f8f41b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:53.011222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1c8dc0e7-d51a-472d-b607-8be2f8f41b43 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:53.012393 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1c8dc0e7-d51a-472d-b607-8be2f8f41b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:53.020665 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:53.176180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1dbaa-5828-419a-9aef-4a7ca215bfd3 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:53.189934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1dbaa-5828-419a-9aef-4a7ca215bfd3 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:53.194959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7837e24e-ef0a-4268-8084-688fd7de1496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:53.195545 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e24e-ef0a-4268-8084-688fd7de1496 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:53.195816 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e24e-ef0a-4268-8084-688fd7de1496 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:53.196080 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7837e24e-ef0a-4268-8084-688fd7de1496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:53.205006 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837e24e-ef0a-4268-8084-688fd7de1496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:53.206611 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7837e24e-ef0a-4268-8084-688fd7de1496 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:53.215924 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 522/1042] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:54.093961 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2ae6-2d1c-4b8d-bcb8-6385e3129f37 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:54.095104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2ae6-2d1c-4b8d-bcb8-6385e3129f37 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:54.095104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce2ae6-2d1c-4b8d-bcb8-6385e3129f37 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:54.096460 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:54.101538 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97902e7-cc7e-433f-b57c-770d01ca0a9d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:54.102078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97902e7-cc7e-433f-b57c-770d01ca0a9d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:54.102572 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97902e7-cc7e-433f-b57c-770d01ca0a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:54.124139 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c97902e7-cc7e-433f-b57c-770d01ca0a9d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:54.125316 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c97902e7-cc7e-433f-b57c-770d01ca0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:54.133214 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:54.288854 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2ae6-2d1c-4b8d-bcb8-6385e3129f37 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:54.302798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce2ae6-2d1c-4b8d-bcb8-6385e3129f37 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:54.307630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bded1-5f26-4dc4-b3bc-0be2a11b19fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:54.308209 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bded1-5f26-4dc4-b3bc-0be2a11b19fe service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:54.308484 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bded1-5f26-4dc4-b3bc-0be2a11b19fe service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:54.308749 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bded1-5f26-4dc4-b3bc-0be2a11b19fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:54.316808 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bded1-5f26-4dc4-b3bc-0be2a11b19fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:54.318385 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34bded1-5f26-4dc4-b3bc-0be2a11b19fe service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:54.327480 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 522/1045] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:55.142208 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07cf34-5685-423e-b2c3-e878e50a8ee7 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.142768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07cf34-5685-423e-b2c3-e878e50a8ee7 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.142768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07cf34-5685-423e-b2c3-e878e50a8ee7 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.144079 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:55.149163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b2a9-17b1-4d78-a3fc-1cb8cb0e1735 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.149951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b2a9-17b1-4d78-a3fc-1cb8cb0e1735 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.150219 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37b2a9-17b1-4d78-a3fc-1cb8cb0e1735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.169985 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2a37b2a9-17b1-4d78-a3fc-1cb8cb0e1735 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:55.171149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2a37b2a9-17b1-4d78-a3fc-1cb8cb0e1735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:55.180010 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:55.335617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07cf34-5685-423e-b2c3-e878e50a8ee7 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:55.349050 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07cf34-5685-423e-b2c3-e878e50a8ee7 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:55.353904 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac1e2dc-d200-4a08-9c1c-07d32ad6f871 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:55.354516 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1e2dc-d200-4a08-9c1c-07d32ad6f871 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:55.354787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1e2dc-d200-4a08-9c1c-07d32ad6f871 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:55.355052 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac1e2dc-d200-4a08-9c1c-07d32ad6f871 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:55.363482 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1e2dc-d200-4a08-9c1c-07d32ad6f871 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:55.365039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac1e2dc-d200-4a08-9c1c-07d32ad6f871 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:55.374131 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 525/1048] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:56.191767 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390952e-0e8f-452b-a7d9-a06b769294b4 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:56.192319 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390952e-0e8f-452b-a7d9-a06b769294b4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:56.192319 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390952e-0e8f-452b-a7d9-a06b769294b4 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:56.193678 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:56.198406 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6eaab-bf42-4677-bf4c-a29f0a39761c None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:56.198817 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6eaab-bf42-4677-bf4c-a29f0a39761c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:56.198950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6eaab-bf42-4677-bf4c-a29f0a39761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:56.218885 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a4f6eaab-bf42-4677-bf4c-a29f0a39761c None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:56.220531 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a4f6eaab-bf42-4677-bf4c-a29f0a39761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:56.228191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:56 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:56.381430 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390952e-0e8f-452b-a7d9-a06b769294b4 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:56.395404 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390952e-0e8f-452b-a7d9-a06b769294b4 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:56.400571 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9cca7-d69a-4db8-8577-9ab3395d251d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:56.401155 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9cca7-d69a-4db8-8577-9ab3395d251d service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:56.401469 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9cca7-d69a-4db8-8577-9ab3395d251d service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:56.401739 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9cca7-d69a-4db8-8577-9ab3395d251d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:56.409638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9cca7-d69a-4db8-8577-9ab3395d251d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:56.411193 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9cca7-d69a-4db8-8577-9ab3395d251d service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:56.421229 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 525/1051] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:56 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:57.229305 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dda81-a7b3-48e6-805d-14c6ae108027 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.229891 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dda81-a7b3-48e6-805d-14c6ae108027 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.229891 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737dda81-a7b3-48e6-805d-14c6ae108027 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.231247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:57.236668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99518a-ef17-4d8e-aece-bd897a43ccda None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.237137 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99518a-ef17-4d8e-aece-bd897a43ccda None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.237250 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db99518a-ef17-4d8e-aece-bd897a43ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.256824 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-db99518a-ef17-4d8e-aece-bd897a43ccda None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:57.258185 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-db99518a-ef17-4d8e-aece-bd897a43ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:57.266729 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:57.420125 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dda81-a7b3-48e6-805d-14c6ae108027 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:57.434786 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737dda81-a7b3-48e6-805d-14c6ae108027 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:57.440320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959eac3e-86aa-43e6-a699-3a8085edbf19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:57.440916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eac3e-86aa-43e6-a699-3a8085edbf19 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:57.441191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eac3e-86aa-43e6-a699-3a8085edbf19 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:57.441499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959eac3e-86aa-43e6-a699-3a8085edbf19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:57.449553 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eac3e-86aa-43e6-a699-3a8085edbf19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:57.451119 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959eac3e-86aa-43e6-a699-3a8085edbf19 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:57.460309 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 528/1054] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:08:58.271947 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e2d2-4dc0-4226-b4f1-a3d128e2cbcd None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:58.272420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e2d2-4dc0-4226-b4f1-a3d128e2cbcd None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:58.272420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0e2d2-4dc0-4226-b4f1-a3d128e2cbcd None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:58.274031 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:08:58.278791 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347271-15c6-4453-ae61-edfe0b86c47d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:58.279164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347271-15c6-4453-ae61-edfe0b86c47d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:58.279330 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b347271-15c6-4453-ae61-edfe0b86c47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:58.299097 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5b347271-15c6-4453-ae61-edfe0b86c47d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:08:58.300291 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5b347271-15c6-4453-ae61-edfe0b86c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:08:58.308197 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:08:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:08:58.484182 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e2d2-4dc0-4226-b4f1-a3d128e2cbcd None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:08:58.497537 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0e2d2-4dc0-4226-b4f1-a3d128e2cbcd None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:08:58.570135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a0185-0f95-49ac-aeef-f43b3ac4378c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:08:58.570135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0185-0f95-49ac-aeef-f43b3ac4378c service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:08:58.570135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0185-0f95-49ac-aeef-f43b3ac4378c service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:08:58.570135 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a0185-0f95-49ac-aeef-f43b3ac4378c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:08:58.571242 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a0185-0f95-49ac-aeef-f43b3ac4378c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:08:58.571242 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a0185-0f95-49ac-aeef-f43b3ac4378c service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:08:58.571242 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 528/1057] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:08:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:00.602871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42225935-bef0-4f4c-840e-abc0d6530cfe None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:00.603436 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42225935-bef0-4f4c-840e-abc0d6530cfe None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:00.603436 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42225935-bef0-4f4c-840e-abc0d6530cfe None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:00.604713 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:00.610524 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d18da-26a7-4b80-aea3-28b9caa01449 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:00.611034 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d18da-26a7-4b80-aea3-28b9caa01449 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:00.611266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d18da-26a7-4b80-aea3-28b9caa01449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:00.630988 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-980d18da-26a7-4b80-aea3-28b9caa01449 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:00.632287 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-980d18da-26a7-4b80-aea3-28b9caa01449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:00.640209 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:00.978684 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42225935-bef0-4f4c-840e-abc0d6530cfe None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:00.991012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42225935-bef0-4f4c-840e-abc0d6530cfe None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:00.994433 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad168c-1465-4a83-b8bd-3f2f8acd103f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:00.995010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad168c-1465-4a83-b8bd-3f2f8acd103f service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:00.995279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad168c-1465-4a83-b8bd-3f2f8acd103f service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:00.995540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad168c-1465-4a83-b8bd-3f2f8acd103f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:01.004692 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad168c-1465-4a83-b8bd-3f2f8acd103f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:01.006134 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad168c-1465-4a83-b8bd-3f2f8acd103f service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:01.015234 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 531/1060] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:03.344266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc69040-37ee-4d6c-882f-907c32c0b843 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:03.345013 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc69040-37ee-4d6c-882f-907c32c0b843 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:03.345013 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc69040-37ee-4d6c-882f-907c32c0b843 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:03.346149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:03.351218 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ea033-946c-4e17-8a64-1f91ae2726c6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:03.351600 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ea033-946c-4e17-8a64-1f91ae2726c6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:03.351751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ea033-946c-4e17-8a64-1f91ae2726c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:03.370615 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-466ea033-946c-4e17-8a64-1f91ae2726c6 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:03.371784 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-466ea033-946c-4e17-8a64-1f91ae2726c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:03.380093 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:03.724743 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc69040-37ee-4d6c-882f-907c32c0b843 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:03.737636 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc69040-37ee-4d6c-882f-907c32c0b843 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:03.741128 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37043fc-9d0d-4170-be1d-b3d557bb6965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:03.741748 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37043fc-9d0d-4170-be1d-b3d557bb6965 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:03.742020 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37043fc-9d0d-4170-be1d-b3d557bb6965 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:03.742285 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37043fc-9d0d-4170-be1d-b3d557bb6965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:03.751611 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37043fc-9d0d-4170-be1d-b3d557bb6965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:03.753021 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37043fc-9d0d-4170-be1d-b3d557bb6965 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:03.762537 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 531/1063] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:06.283065 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2cc8e-a064-491f-911a-2c811aa3e54f None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:06.283588 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2cc8e-a064-491f-911a-2c811aa3e54f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:06.283588 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2cc8e-a064-491f-911a-2c811aa3e54f None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:06.284924 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:09:06.290091 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2eccf-82e6-490a-876e-7e43fd0c79bb None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:06.290512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2eccf-82e6-490a-876e-7e43fd0c79bb None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:06.290612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2eccf-82e6-490a-876e-7e43fd0c79bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:06.309923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-1aa2eccf-82e6-490a-876e-7e43fd0c79bb None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:06.311104 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-1aa2eccf-82e6-490a-876e-7e43fd0c79bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:06.319488 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:09:06.659961 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2cc8e-a064-491f-911a-2c811aa3e54f None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:06.671370 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2cc8e-a064-491f-911a-2c811aa3e54f None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:06.675582 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66de56-287d-4c2d-b339-62a5ac8d279a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:06.676165 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66de56-287d-4c2d-b339-62a5ac8d279a service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:06.676437 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66de56-287d-4c2d-b339-62a5ac8d279a service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:06.676699 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66de56-287d-4c2d-b339-62a5ac8d279a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:06.685451 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66de56-287d-4c2d-b339-62a5ac8d279a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:06.686899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66de56-287d-4c2d-b339-62a5ac8d279a service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:06.696183 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 534/1066] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:09.092319 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56824bf9-4e6f-4cd0-b55f-8ae3a5a6cbe8 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:09.092835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56824bf9-4e6f-4cd0-b55f-8ae3a5a6cbe8 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:09.092835 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56824bf9-4e6f-4cd0-b55f-8ae3a5a6cbe8 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:09.094905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:09.100075 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45aa19-c2d7-4b20-979b-5c263d4cb05e None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:09.100498 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45aa19-c2d7-4b20-979b-5c263d4cb05e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:09.100649 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45aa19-c2d7-4b20-979b-5c263d4cb05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:09.119988 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-8b45aa19-c2d7-4b20-979b-5c263d4cb05e None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:09.121182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8b45aa19-c2d7-4b20-979b-5c263d4cb05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:09.129118 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:09.473716 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56824bf9-4e6f-4cd0-b55f-8ae3a5a6cbe8 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:09.484487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56824bf9-4e6f-4cd0-b55f-8ae3a5a6cbe8 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:09.487919 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491c73e-54a4-4d1f-ab7b-e683ef39e2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:09.488494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491c73e-54a4-4d1f-ab7b-e683ef39e2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:09.488761 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491c73e-54a4-4d1f-ab7b-e683ef39e2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:09.489024 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491c73e-54a4-4d1f-ab7b-e683ef39e2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:09.497782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491c73e-54a4-4d1f-ab7b-e683ef39e2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:09.499186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491c73e-54a4-4d1f-ab7b-e683ef39e2e8 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:09.508280 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 534/1069] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:11.761499 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4c6f-a9df-4e3d-91ea-78e53955b9ec None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:11.762055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4c6f-a9df-4e3d-91ea-78e53955b9ec None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:11.762055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a4c6f-a9df-4e3d-91ea-78e53955b9ec None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:11.763377 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:11.769032 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73d010-4a74-4435-943e-4aa8f786693a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:11.769450 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73d010-4a74-4435-943e-4aa8f786693a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:11.769608 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73d010-4a74-4435-943e-4aa8f786693a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:11.789015 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-7a73d010-4a74-4435-943e-4aa8f786693a None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:11.790205 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-7a73d010-4a74-4435-943e-4aa8f786693a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:11.797870 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:12.139792 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a4c6f-a9df-4e3d-91ea-78e53955b9ec None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:12.151759 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a4c6f-a9df-4e3d-91ea-78e53955b9ec None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:12.155208 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc5d80-df48-4527-a669-9595ef2fc5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:12.155840 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc5d80-df48-4527-a669-9595ef2fc5bd service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:12.156267 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc5d80-df48-4527-a669-9595ef2fc5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:12.156543 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc5d80-df48-4527-a669-9595ef2fc5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:12.168928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc5d80-df48-4527-a669-9595ef2fc5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:12.170614 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc5d80-df48-4527-a669-9595ef2fc5bd service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:12.181412 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 537/1072] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:14.434343 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81972b-a715-4d92-ad4f-90a884506551 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.434903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81972b-a715-4d92-ad4f-90a884506551 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.434903 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d81972b-a715-4d92-ad4f-90a884506551 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.436240 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:14.442057 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647aece-5436-4018-96f3-2e45ec664d63 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.442445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647aece-5436-4018-96f3-2e45ec664d63 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.442603 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647aece-5436-4018-96f3-2e45ec664d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.462171 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c647aece-5436-4018-96f3-2e45ec664d63 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:14.463354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c647aece-5436-4018-96f3-2e45ec664d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:14.471033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:14.819456 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81972b-a715-4d92-ad4f-90a884506551 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:14.824745 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=64 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:14.831834 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d81972b-a715-4d92-ad4f-90a884506551 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:14.835230 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1220caf-4379-4c75-b0aa-2cd3ea8d0eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:14.835805 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220caf-4379-4c75-b0aa-2cd3ea8d0eac service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:14.836075 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220caf-4379-4c75-b0aa-2cd3ea8d0eac service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:14.836338 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1220caf-4379-4c75-b0aa-2cd3ea8d0eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:14.845960 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1220caf-4379-4c75-b0aa-2cd3ea8d0eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:14.847360 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1220caf-4379-4c75-b0aa-2cd3ea8d0eac service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:14.856318 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 537/1075] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:17.099440 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0659c6-b0d8-4a57-8751-cc2bed21fd9e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:17.099983 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0659c6-b0d8-4a57-8751-cc2bed21fd9e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:17.099983 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0659c6-b0d8-4a57-8751-cc2bed21fd9e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:17.101338 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:17.106576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577478-7b91-48ac-a1d8-f4eec7105e5c None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:17.106996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577478-7b91-48ac-a1d8-f4eec7105e5c None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:17.107102 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577478-7b91-48ac-a1d8-f4eec7105e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:17.126812 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-30577478-7b91-48ac-a1d8-f4eec7105e5c None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:17.127989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-30577478-7b91-48ac-a1d8-f4eec7105e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:17.135588 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:17.479851 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0659c6-b0d8-4a57-8751-cc2bed21fd9e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:17.485909 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=73 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:17.492096 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0659c6-b0d8-4a57-8751-cc2bed21fd9e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:17.495584 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b742050-aee8-4ea4-87d0-c861a908e5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:17.496164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742050-aee8-4ea4-87d0-c861a908e5ef service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:17.496435 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742050-aee8-4ea4-87d0-c861a908e5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:17.496700 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b742050-aee8-4ea4-87d0-c861a908e5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:17.505614 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b742050-aee8-4ea4-87d0-c861a908e5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:17.507032 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b742050-aee8-4ea4-87d0-c861a908e5ef service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:17.516178 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 540/1078] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:19.758122 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3046b-1c69-458e-a66e-784f83aaa2cb None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:19.758708 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3046b-1c69-458e-a66e-784f83aaa2cb None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:19.758708 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3046b-1c69-458e-a66e-784f83aaa2cb None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:19.759996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:19.765381 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00420d5-2e4f-4af7-8ad5-c279f4b04a5d None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:19.766501 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00420d5-2e4f-4af7-8ad5-c279f4b04a5d None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:19.766501 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00420d5-2e4f-4af7-8ad5-c279f4b04a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:19.785353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f00420d5-2e4f-4af7-8ad5-c279f4b04a5d None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:19.786550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f00420d5-2e4f-4af7-8ad5-c279f4b04a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:19.794353 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:20.137239 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3046b-1c69-458e-a66e-784f83aaa2cb None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:20.149076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3046b-1c69-458e-a66e-784f83aaa2cb None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:20.152520 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a6995-aefc-4dcb-8e02-18044f623d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:20.153093 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6995-aefc-4dcb-8e02-18044f623d76 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:20.153402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6995-aefc-4dcb-8e02-18044f623d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:20.153672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a6995-aefc-4dcb-8e02-18044f623d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:20.163062 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6995-aefc-4dcb-8e02-18044f623d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:20.164472 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a6995-aefc-4dcb-8e02-18044f623d76 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:20.173688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 540/1081] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:22.408306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6206a-246c-4d0f-8516-8f0eaff7fc6e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.408882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6206a-246c-4d0f-8516-8f0eaff7fc6e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.408882 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6206a-246c-4d0f-8516-8f0eaff7fc6e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.410232 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:22.415439 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370bfa5-1be7-4c5a-b994-43d1917191d1 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.415875 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370bfa5-1be7-4c5a-b994-43d1917191d1 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.415969 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370bfa5-1be7-4c5a-b994-43d1917191d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.435054 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2370bfa5-1be7-4c5a-b994-43d1917191d1 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:22.436246 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2370bfa5-1be7-4c5a-b994-43d1917191d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:22.444555 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:22.784626 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6206a-246c-4d0f-8516-8f0eaff7fc6e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:22.795164 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6206a-246c-4d0f-8516-8f0eaff7fc6e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:22.799283 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8e5357-dd20-4b11-a51a-debd26c1463f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:22.799860 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5357-dd20-4b11-a51a-debd26c1463f service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:22.800130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5357-dd20-4b11-a51a-debd26c1463f service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:22.800393 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8e5357-dd20-4b11-a51a-debd26c1463f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:22.808905 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5357-dd20-4b11-a51a-debd26c1463f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:22.810337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8e5357-dd20-4b11-a51a-debd26c1463f service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:22.819528 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 543/1084] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:25.022006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c079-cc66-4c1f-b809-84c438e350f7 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.022514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c079-cc66-4c1f-b809-84c438e350f7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.022630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca2c079-cc66-4c1f-b809-84c438e350f7 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.024129 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:25.029366 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953e7f-78ee-452e-a2f9-df6f5366a280 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.029809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953e7f-78ee-452e-a2f9-df6f5366a280 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.029907 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953e7f-78ee-452e-a2f9-df6f5366a280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.048909 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b6953e7f-78ee-452e-a2f9-df6f5366a280 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:25.050113 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b6953e7f-78ee-452e-a2f9-df6f5366a280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:25.057639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:09:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:25.395236 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2c079-cc66-4c1f-b809-84c438e350f7 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:25.406655 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca2c079-cc66-4c1f-b809-84c438e350f7 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:25.410148 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69606558-4191-48f1-a765-2b0390c78da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:25.410730 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69606558-4191-48f1-a765-2b0390c78da2 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:25.411003 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69606558-4191-48f1-a765-2b0390c78da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:25.411272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69606558-4191-48f1-a765-2b0390c78da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:25.419996 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69606558-4191-48f1-a765-2b0390c78da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:25.421551 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69606558-4191-48f1-a765-2b0390c78da2 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:25.430823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 543/1087] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:35.043685 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=17 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:35.426768 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=23 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:09:49.635496 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1291-ee0b-4165-bb56-49f112adcd2c None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:49.636064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1291-ee0b-4165-bb56-49f112adcd2c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:49.636064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde1291-ee0b-4165-bb56-49f112adcd2c None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:49.637417 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 545/1088] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:49.643126 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf372b-a11c-4c3b-bf39-ba0e0472eabb None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:49.643560 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf372b-a11c-4c3b-bf39-ba0e0472eabb None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:49.643700 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf372b-a11c-4c3b-bf39-ba0e0472eabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:49.662444 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-94cf372b-a11c-4c3b-bf39-ba0e0472eabb None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:49.663623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-94cf372b-a11c-4c3b-bf39-ba0e0472eabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:49.671228 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 544/1089] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:50.027279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759968a-0e3b-4bd5-8866-d72fd5d4ced4 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:50.027558 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759968a-0e3b-4bd5-8866-d72fd5d4ced4 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:50.027829 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759968a-0e3b-4bd5-8866-d72fd5d4ced4 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:50.029864 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 546/1090] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 17 16:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:50.035419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f938db-96c8-47aa-bd38-301199ccba3b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:50.035700 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f938db-96c8-47aa-bd38-301199ccba3b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:50.035972 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f938db-96c8-47aa-bd38-301199ccba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:50.054638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-60f938db-96c8-47aa-bd38-301199ccba3b None None] MFA Rules not processed for user `c222aec3576b436b8bfcef46f12751ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:50.055814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-60f938db-96c8-47aa-bd38-301199ccba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:50.062202 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 545/1091] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 17 16:09:50 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:50.069182 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759968a-0e3b-4bd5-8866-d72fd5d4ced4 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:50.080707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759968a-0e3b-4bd5-8866-d72fd5d4ced4 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:50.084256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c58e-2d53-47fe-9570-4210db8bf556 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c222aec3576b436b8bfcef46f12751ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:50.084843 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c58e-2d53-47fe-9570-4210db8bf556 service glance] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:50.085117 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c58e-2d53-47fe-9570-4210db8bf556 service glance] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:50.085413 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c58e-2d53-47fe-9570-4210db8bf556 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:50.095630 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250c58e-2d53-47fe-9570-4210db8bf556 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:50.097049 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5250c58e-2d53-47fe-9570-4210db8bf556 service glance] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:50.106429 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 547/1092] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:52.382186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada13e-9727-49e7-adcf-4c1f72af7114 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:52.382746 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada13e-9727-49e7-adcf-4c1f72af7114 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:52.382746 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada13e-9727-49e7-adcf-4c1f72af7114 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:52.384090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 546/1093] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:52.390379 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e1a7-9bf8-48fa-ba73-5f4c631563e3 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:52.390815 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e1a7-9bf8-48fa-ba73-5f4c631563e3 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:52.390909 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5e1a7-9bf8-48fa-ba73-5f4c631563e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:52.411211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-70d5e1a7-9bf8-48fa-ba73-5f4c631563e3 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:52.412407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-70d5e1a7-9bf8-48fa-ba73-5f4c631563e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:52.420135 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 548/1094] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:52.753152 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada13e-9727-49e7-adcf-4c1f72af7114 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:52.766150 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada13e-9727-49e7-adcf-4c1f72af7114 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:52.770576 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f7594-a1a8-40d2-b6c4-61c0eca0c2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:52.771153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7594-a1a8-40d2-b6c4-61c0eca0c2da admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:52.771428 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7594-a1a8-40d2-b6c4-61c0eca0c2da admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:52.771696 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f7594-a1a8-40d2-b6c4-61c0eca0c2da admin admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:52.772323 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f7594-a1a8-40d2-b6c4-61c0eca0c2da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:52.774352 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-c38f7594-a1a8-40d2-b6c4-61c0eca0c2da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:09:52.774352 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 17 16:09:52.774352 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: Aug 17 16:09:52.775517 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f7594-a1a8-40d2-b6c4-61c0eca0c2da admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:52.793537 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 547/1095] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 17 16:09:52 2022] GET /identity/v3/projects => generated 1606 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:09:54.992879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d695-75bf-4034-9a5d-42fd62e056be None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:54.993290 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d695-75bf-4034-9a5d-42fd62e056be None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:54.993473 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d695-75bf-4034-9a5d-42fd62e056be None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:54.994840 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 549/1096] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:55.000406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e2d-8aa8-413b-964b-402614f42fc5 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:55.000818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e2d-8aa8-413b-964b-402614f42fc5 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:55.000953 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f6e2d-8aa8-413b-964b-402614f42fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:55.020257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b23f6e2d-8aa8-413b-964b-402614f42fc5 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:55.021466 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b23f6e2d-8aa8-413b-964b-402614f42fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:55.029433 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 548/1097] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:55.379339 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d695-75bf-4034-9a5d-42fd62e056be None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:55.394954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d695-75bf-4034-9a5d-42fd62e056be None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:55.400139 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c0f5f-893e-487e-a783-b9fe7c8246b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:55.400832 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c0f5f-893e-487e-a783-b9fe7c8246b8 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:55.401111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c0f5f-893e-487e-a783-b9fe7c8246b8 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:55.401412 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c0f5f-893e-487e-a783-b9fe7c8246b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:55.410046 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c0f5f-893e-487e-a783-b9fe7c8246b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:55.411683 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c0f5f-893e-487e-a783-b9fe7c8246b8 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:55.421383 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 550/1098] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:09:57.770418 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866e162-4030-4a6a-a765-d885df17e816 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:57.770987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866e162-4030-4a6a-a765-d885df17e816 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:57.770987 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866e162-4030-4a6a-a765-d885df17e816 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:57.772288 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 549/1099] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:09:57.777701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c049a7-5078-414e-b4de-522f745b7832 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:57.778140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c049a7-5078-414e-b4de-522f745b7832 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:57.778252 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c049a7-5078-414e-b4de-522f745b7832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:57.798059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-b0c049a7-5078-414e-b4de-522f745b7832 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:09:57.799258 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b0c049a7-5078-414e-b4de-522f745b7832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:09:57.807319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 551/1100] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:09:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:09:58.151305 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866e162-4030-4a6a-a765-d885df17e816 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:09:58.162186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866e162-4030-4a6a-a765-d885df17e816 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:09:58.165581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b7b38-7031-4d93-bd56-76461ae07859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:09:58.166158 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7b38-7031-4d93-bd56-76461ae07859 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:09:58.166429 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7b38-7031-4d93-bd56-76461ae07859 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:09:58.166692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b7b38-7031-4d93-bd56-76461ae07859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:09:58.176012 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b7b38-7031-4d93-bd56-76461ae07859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:09:58.177453 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b7b38-7031-4d93-bd56-76461ae07859 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:09:58.187540 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 550/1101] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:09:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:00.418668 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bfbd8-2e87-4d38-b4a3-4a229a562ada None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:00.419738 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bfbd8-2e87-4d38-b4a3-4a229a562ada None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:00.419847 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8bfbd8-2e87-4d38-b4a3-4a229a562ada None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:00.421235 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 552/1102] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:10:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:00.426412 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61d69d-4b95-40b6-9f07-40d7c5938191 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:00.426839 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61d69d-4b95-40b6-9f07-40d7c5938191 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:00.426929 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d61d69d-4b95-40b6-9f07-40d7c5938191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:00.445989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-0d61d69d-4b95-40b6-9f07-40d7c5938191 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:00.447154 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-0d61d69d-4b95-40b6-9f07-40d7c5938191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:00.455323 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 551/1103] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:00.800884 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bfbd8-2e87-4d38-b4a3-4a229a562ada None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:00.811762 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8bfbd8-2e87-4d38-b4a3-4a229a562ada None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:00.815369 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa4092-c05e-449c-9391-b4eb2901df9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:00.815950 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4092-c05e-449c-9391-b4eb2901df9e service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:00.816225 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4092-c05e-449c-9391-b4eb2901df9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:00.816494 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4092-c05e-449c-9391-b4eb2901df9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:00.825100 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa4092-c05e-449c-9391-b4eb2901df9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:00.826670 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa4092-c05e-449c-9391-b4eb2901df9e service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:00.835812 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 553/1104] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:03.266634 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a8cd0-de9c-4f7b-b7f8-735b4271044e None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:03.267138 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a8cd0-de9c-4f7b-b7f8-735b4271044e None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:03.267138 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a8cd0-de9c-4f7b-b7f8-735b4271044e None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:03.268451 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 552/1105] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:03.273879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496612a-0c1d-4552-97af-705ebd25822f None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:03.274284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496612a-0c1d-4552-97af-705ebd25822f None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:03.274423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496612a-0c1d-4552-97af-705ebd25822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:03.293445 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7496612a-0c1d-4552-97af-705ebd25822f None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:03.295678 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7496612a-0c1d-4552-97af-705ebd25822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:03.303207 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 554/1106] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:03.667279 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a8cd0-de9c-4f7b-b7f8-735b4271044e None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:03.678659 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a8cd0-de9c-4f7b-b7f8-735b4271044e None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:03.682142 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4fab6-fa83-4554-9fa4-e5f9ae2a7237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:03.682727 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4fab6-fa83-4554-9fa4-e5f9ae2a7237 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:03.683004 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4fab6-fa83-4554-9fa4-e5f9ae2a7237 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:03.683277 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4fab6-fa83-4554-9fa4-e5f9ae2a7237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:03.692241 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4fab6-fa83-4554-9fa4-e5f9ae2a7237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:03.693759 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4fab6-fa83-4554-9fa4-e5f9ae2a7237 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:03.703066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 553/1107] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:06.120900 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22125-8c5f-4f95-a1c3-850dbca79ebb None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:06.121474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22125-8c5f-4f95-a1c3-850dbca79ebb None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:06.121474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f22125-8c5f-4f95-a1c3-850dbca79ebb None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:06.124078 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 555/1108] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 17 16:10:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:10:06.129385 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2562900-3d05-464c-ac47-46b008cf3dc2 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:06.129871 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2562900-3d05-464c-ac47-46b008cf3dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:06.130041 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2562900-3d05-464c-ac47-46b008cf3dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:06.150706 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c2562900-3d05-464c-ac47-46b008cf3dc2 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:10:06.151890 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c2562900-3d05-464c-ac47-46b008cf3dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:10:06.161199 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 554/1109] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 17 16:10:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:10:06.523068 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f22125-8c5f-4f95-a1c3-850dbca79ebb None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:10:06.534033 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f22125-8c5f-4f95-a1c3-850dbca79ebb None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:10:06.537680 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8f82e-626f-47f2-9fe9-e712d732736b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:10:06.538257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f82e-626f-47f2-9fe9-e712d732736b service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:10:06.538533 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f82e-626f-47f2-9fe9-e712d732736b service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:10:06.538801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8f82e-626f-47f2-9fe9-e712d732736b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:10:06.548375 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8f82e-626f-47f2-9fe9-e712d732736b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:10:06.549905 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8f82e-626f-47f2-9fe9-e712d732736b service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:10:06.560621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 556/1110] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:10:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:10:16.145798 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=33 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:10:16.555146 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=33 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:26.874828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e39d-58da-427e-bb6b-6f9d6c390b98 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:26.875448 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e39d-58da-427e-bb6b-6f9d6c390b98 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:26.875448 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1e39d-58da-427e-bb6b-6f9d6c390b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:26.894232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-41c1e39d-58da-427e-bb6b-6f9d6c390b98 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:26.895414 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-41c1e39d-58da-427e-bb6b-6f9d6c390b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:26.903910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 555/1111] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:11:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:26.912185 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064fcfa-8b9d-4d2b-b718-671094a7ec85 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:26.912723 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064fcfa-8b9d-4d2b-b718-671094a7ec85 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:26.912723 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064fcfa-8b9d-4d2b-b718-671094a7ec85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:26.931971 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f064fcfa-8b9d-4d2b-b718-671094a7ec85 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:26.933151 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f064fcfa-8b9d-4d2b-b718-671094a7ec85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:26.940834 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 557/1112] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:11:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:26.945266 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1e39d-58da-427e-bb6b-6f9d6c390b98 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:26.955066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1e39d-58da-427e-bb6b-6f9d6c390b98 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:26.960699 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:26.961288 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:26.961592 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:26.961860 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:26.963110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:11:26.963406 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:26.964418 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:26.964418 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 17 16:11:26.964418 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: Aug 17 16:11:26.965289 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:26.978072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 556/1113] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 17 16:11:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:11:26.986827 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064fcfa-8b9d-4d2b-b718-671094a7ec85 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:26.996488 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064fcfa-8b9d-4d2b-b718-671094a7ec85 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.000996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.001605 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.001878 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.002143 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.002747 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.004506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:27.004506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 17 16:11:27.004506 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: Aug 17 16:11:27.005717 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.033154 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 558/1114] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 17 16:11:26 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:11:27.037599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:27.047707 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba6b00-c848-401e-a2bb-cc25bb895603 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.105961 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.106575 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.106830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.107099 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.107715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.108737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:27.108737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 17 16:11:27.108737 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: Aug 17 16:11:27.109959 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.131542 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 557/1115] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:11:27 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:11:27.136491 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:27.146634 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010e6fd-9558-4679-b728-9df1d527275c admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.151450 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.152118 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.152399 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.152677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.153306 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.154348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:27.154348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 17 16:11:27.154348 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: Aug 17 16:11:27.155225 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.167953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 559/1116] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:11:27.171800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:27.181995 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba048da3-717f-4c1b-8d48-c0fe5be59f95 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.186479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a914df4-1f7e-494a-b05d-be7bc8d06416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.187057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914df4-1f7e-494a-b05d-be7bc8d06416 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.187334 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914df4-1f7e-494a-b05d-be7bc8d06416 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.187604 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a914df4-1f7e-494a-b05d-be7bc8d06416 admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.188233 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a914df4-1f7e-494a-b05d-be7bc8d06416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.189230 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-3a914df4-1f7e-494a-b05d-be7bc8d06416 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:27.189230 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 17 16:11:27.189230 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: Aug 17 16:11:27.190131 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a914df4-1f7e-494a-b05d-be7bc8d06416 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.204145 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 558/1117] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:11:27.208273 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:27.218119 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d946-64bb-4b8b-ac59-fa069ca54382 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.222673 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e47d18-f76a-4463-b044-1ecb50cf7d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.223304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e47d18-f76a-4463-b044-1ecb50cf7d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.223576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e47d18-f76a-4463-b044-1ecb50cf7d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.223844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e47d18-f76a-4463-b044-1ecb50cf7d8f admin admin] PATH_INFO: `/v3/projects/fa90ac84acd949fdabb4153b0477b981/users/8d39c14286994858bb053b7a1168b49a/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.238906 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e47d18-f76a-4463-b044-1ecb50cf7d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa90ac84acd949fdabb4153b0477b981, user_id=8d39c14286994858bb053b7a1168b49a, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.239921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-37e47d18-f76a-4463-b044-1ecb50cf7d8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:27.239921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 17 16:11:27.239921 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: Aug 17 16:11:27.241857 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e47d18-f76a-4463-b044-1ecb50cf7d8f admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.255163 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 560/1118] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 17 16:11:27 2022] PUT /identity/v3/projects/fa90ac84acd949fdabb4153b0477b981/users/8d39c14286994858bb053b7a1168b49a/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:11:27.267800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2232-a12b-4d89-824f-66e9ed7cf493 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.268107 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2232-a12b-4d89-824f-66e9ed7cf493 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.268384 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea2232-a12b-4d89-824f-66e9ed7cf493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.296736 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-e7ea2232-a12b-4d89-824f-66e9ed7cf493 None None] MFA Rules not processed for user `8d39c14286994858bb053b7a1168b49a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:27.297963 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e7ea2232-a12b-4d89-824f-66e9ed7cf493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:27.361074 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 559/1119] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:11:27 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:27.374770 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ca9b-bfa0-4ef0-b6a4-1c6ccc0b3ad1 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.375045 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ca9b-bfa0-4ef0-b6a4-1c6ccc0b3ad1 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.375312 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09ca9b-bfa0-4ef0-b6a4-1c6ccc0b3ad1 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.376661 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 561/1120] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 17 16:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:11:27.381299 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8582e-d60b-41c9-85ac-dc2ca216f265 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.381679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8582e-d60b-41c9-85ac-dc2ca216f265 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.381910 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8582e-d60b-41c9-85ac-dc2ca216f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.401166 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b2c8582e-d60b-41c9-85ac-dc2ca216f265 None None] MFA Rules not processed for user `738338255eae424ebc3ab73e2cf6b203`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:27.402381 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b2c8582e-d60b-41c9-85ac-dc2ca216f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:27.445432 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:27.453717 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 560/1121] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 17 16:11:27 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:27.461826 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09ca9b-bfa0-4ef0-b6a4-1c6ccc0b3ad1 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:27.472515 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09ca9b-bfa0-4ef0-b6a4-1c6ccc0b3ad1 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.475953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738338255eae424ebc3ab73e2cf6b203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.476554 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.476823 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.477082 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.485586 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.486995 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.496447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 562/1122] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:11:27 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:11:27.534281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94402c1-2684-43f3-9d41-57eda5bc3868 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.534560 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94402c1-2684-43f3-9d41-57eda5bc3868 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.534825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94402c1-2684-43f3-9d41-57eda5bc3868 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.536084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 561/1123] 10.222.0.47 () {52 vars in 830 bytes} [Wed Aug 17 16:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:11:27.539539 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:27.601505 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad95c10-b3af-4ade-9597-11025a5f1afe service cinder] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.606982 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.607593 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.607865 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.608130 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] PATH_INFO: `/v3/users/8d39c14286994858bb053b7a1168b49a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.609291 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d39c14286994858bb053b7a1168b49a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.610319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:27.610319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 17 16:11:27.610319 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: Aug 17 16:11:27.611503 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.679184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d39c14286994858bb053b7a1168b49a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:27.694132 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d39c14286994858bb053b7a1168b49a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:27.717959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d39c14286994858bb053b7a1168b49a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:27.726402 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d39c14286994858bb053b7a1168b49a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:27.727162 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d39c14286994858bb053b7a1168b49a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:27.733184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 563/1124] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 17 16:11:27 2022] DELETE /identity/v3/users/8d39c14286994858bb053b7a1168b49a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:11:27.737606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.737891 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.738167 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.756836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:11:27.758067 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:27.816095 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 562/1125] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:11:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:11:27.825719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:27.827098 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:27.832420 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:27.886242 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19bb8d-642c-44eb-b838-afbf69bc7702 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:27.889878 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e446c-f2c4-4f2f-bde0-1f1dc8c87656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:27.890483 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e446c-f2c4-4f2f-bde0-1f1dc8c87656 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:27.890761 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e446c-f2c4-4f2f-bde0-1f1dc8c87656 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:27.891034 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e446c-f2c4-4f2f-bde0-1f1dc8c87656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:27.900150 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e446c-f2c4-4f2f-bde0-1f1dc8c87656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:27.901793 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e446c-f2c4-4f2f-bde0-1f1dc8c87656 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:27.911394 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 564/1126] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:11:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:11:28.249107 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:11:28.254245 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:11:28.266814 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd81a94-f81c-4c69-9d17-c23e37e8e4ae None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:11:28.271715 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:11:28.272606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:11:28.272932 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:11:28.273161 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] PATH_INFO: `/v3/projects/fa90ac84acd949fdabb4153b0477b981` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:11:28.274315 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa90ac84acd949fdabb4153b0477b981)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:11:28.275329 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:11:28.275329 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 17 16:11:28.275329 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: Aug 17 16:11:28.278537 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:11:28.340127 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa90ac84acd949fdabb4153b0477b981', 'request_id': 'req-daae5074-c9eb-4922-80f4-d2ee913bf045'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:28.346222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa90ac84acd949fdabb4153b0477b981', 'request_id': 'req-daae5074-c9eb-4922-80f4-d2ee913bf045'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:28.356515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa90ac84acd949fdabb4153b0477b981', 'request_id': 'req-daae5074-c9eb-4922-80f4-d2ee913bf045'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:28.375619 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] The token cache is being invalidate because project fa90ac84acd949fdabb4153b0477b981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:11:28.375907 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:28.376542 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-daae5074-c9eb-4922-80f4-d2ee913bf045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:11:28.378147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 563/1127] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 17 16:11:28 2022] DELETE /identity/v3/projects/fa90ac84acd949fdabb4153b0477b981 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:11:37.907352 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=25 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:11:38.372586 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:12:50.255140 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ada1-b193-4c57-9184-f79cdf665891 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:50.255722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ada1-b193-4c57-9184-f79cdf665891 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:50.255722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6ada1-b193-4c57-9184-f79cdf665891 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:50.256965 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:12:50.262147 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32475ae9-ab31-42b0-902a-09a10b6e35f6 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:50.262572 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32475ae9-ab31-42b0-902a-09a10b6e35f6 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:50.262679 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32475ae9-ab31-42b0-902a-09a10b6e35f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:50.330435 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-32475ae9-ab31-42b0-902a-09a10b6e35f6 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:12:50.331658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-32475ae9-ab31-42b0-902a-09a10b6e35f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:12:50.424712 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:12:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:12:50.584724 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ada1-b193-4c57-9184-f79cdf665891 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:12:50.586423 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-3ba6ada1-b193-4c57-9184-f79cdf665891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:12:50.675337 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6ada1-b193-4c57-9184-f79cdf665891 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:12:50.680169 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535868c-b688-479d-9d49-7698821b6b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:12:50.680783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535868c-b688-479d-9d49-7698821b6b96 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:50.681055 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535868c-b688-479d-9d49-7698821b6b96 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:50.681367 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535868c-b688-479d-9d49-7698821b6b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:50.689495 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535868c-b688-479d-9d49-7698821b6b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:12:50.691054 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535868c-b688-479d-9d49-7698821b6b96 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:12:50.700943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 566/1130] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:12:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:12:51.543358 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47080766-48a4-4633-b9ab-99bf011dbc4d None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:51.543913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47080766-48a4-4633-b9ab-99bf011dbc4d None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:51.543913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47080766-48a4-4633-b9ab-99bf011dbc4d None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:51.545224 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:12:51.550061 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4fcce-89ba-43f1-994d-727b90477532 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:51.550460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4fcce-89ba-43f1-994d-727b90477532 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:51.550619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4fcce-89ba-43f1-994d-727b90477532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:51.570374 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c6f4fcce-89ba-43f1-994d-727b90477532 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:12:51.571516 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c6f4fcce-89ba-43f1-994d-727b90477532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:12:51.579801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:12:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:12:51.740076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47080766-48a4-4633-b9ab-99bf011dbc4d None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:12:51.753934 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47080766-48a4-4633-b9ab-99bf011dbc4d None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:12:51.758740 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11661a01-2ba5-45b3-8fb3-b21afafd5ad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:12:51.759322 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11661a01-2ba5-45b3-8fb3-b21afafd5ad5 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:51.759595 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11661a01-2ba5-45b3-8fb3-b21afafd5ad5 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:51.759863 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11661a01-2ba5-45b3-8fb3-b21afafd5ad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:51.768502 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11661a01-2ba5-45b3-8fb3-b21afafd5ad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:12:51.770120 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11661a01-2ba5-45b3-8fb3-b21afafd5ad5 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:12:51.779973 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 566/1133] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:12:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:12:56.746733 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2b1a-1d66-498b-98d2-b3fbb7d6b275 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:56.747392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2b1a-1d66-498b-98d2-b3fbb7d6b275 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:56.747392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2b1a-1d66-498b-98d2-b3fbb7d6b275 None None] PATH_INFO: `/v3` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:56.748861 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 568/1134] 10.222.0.46 () {54 vars in 925 bytes} [Wed Aug 17 16:12:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 16:12:56.764988 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326630e0-0ec8-4170-8cc1-cd455f4fa1e7 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:12:56.765465 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326630e0-0ec8-4170-8cc1-cd455f4fa1e7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:12:56.765578 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326630e0-0ec8-4170-8cc1-cd455f4fa1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:12:56.794978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-326630e0-0ec8-4170-8cc1-cd455f4fa1e7 None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:12:56.796188 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-326630e0-0ec8-4170-8cc1-cd455f4fa1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:12:56.852570 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:12:56.862521 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 567/1135] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Aug 17 16:12:56 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:01.334664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd590685-fa3c-453f-892e-683ab39be08e None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:01.335217 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd590685-fa3c-453f-892e-683ab39be08e None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:01.335217 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd590685-fa3c-453f-892e-683ab39be08e None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:01.336560 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 569/1136] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 17 16:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:01.341838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d412c-ffc9-459e-a0d0-d80e255171d4 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:01.342271 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d412c-ffc9-459e-a0d0-d80e255171d4 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:01.342378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d412c-ffc9-459e-a0d0-d80e255171d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:01.369133 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b01d412c-ffc9-459e-a0d0-d80e255171d4 None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:01.371860 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b01d412c-ffc9-459e-a0d0-d80e255171d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:01.386963 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 568/1137] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 17 16:13:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:01.394669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd590685-fa3c-453f-892e-683ab39be08e None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:01.410012 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd590685-fa3c-453f-892e-683ab39be08e None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:01.414912 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b02de0-fea1-4f6b-ad50-c33e2d7a01f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6772c5cbd29741078f90ea0aadb2ddbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:01.415510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02de0-fea1-4f6b-ad50-c33e2d7a01f7 service placement] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:01.415781 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02de0-fea1-4f6b-ad50-c33e2d7a01f7 service placement] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:01.416045 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b02de0-fea1-4f6b-ad50-c33e2d7a01f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:01.426155 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b02de0-fea1-4f6b-ad50-c33e2d7a01f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:01.427748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b02de0-fea1-4f6b-ad50-c33e2d7a01f7 service placement] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:01.439111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 570/1138] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:01 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:03.027990 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6890a-e5c7-4a40-bd57-c286914c5932 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:03.028504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6890a-e5c7-4a40-bd57-c286914c5932 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:03.028504 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6890a-e5c7-4a40-bd57-c286914c5932 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:03.029913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:13:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:03.034647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701306-1a26-4aed-9342-74d11f7ad8ef None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:03.035072 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701306-1a26-4aed-9342-74d11f7ad8ef None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:03.035177 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701306-1a26-4aed-9342-74d11f7ad8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:03.054191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-f3701306-1a26-4aed-9342-74d11f7ad8ef None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:03.055379 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-f3701306-1a26-4aed-9342-74d11f7ad8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:03.063766 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:13:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:03.224864 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6890a-e5c7-4a40-bd57-c286914c5932 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:03.238752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6890a-e5c7-4a40-bd57-c286914c5932 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:03.243507 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c71e91-6f32-4e8c-99ef-e734a6437bdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:03.244081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c71e91-6f32-4e8c-99ef-e734a6437bdf service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:03.244350 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c71e91-6f32-4e8c-99ef-e734a6437bdf service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:03.244611 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c71e91-6f32-4e8c-99ef-e734a6437bdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:03.252913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c71e91-6f32-4e8c-99ef-e734a6437bdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:03.254497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c71e91-6f32-4e8c-99ef-e734a6437bdf service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:03.264685 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 570/1141] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:04.093803 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4f1f-1c6c-4ce7-9ebb-6c2ff15a876c None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:04.094334 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4f1f-1c6c-4ce7-9ebb-6c2ff15a876c None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:04.094334 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e4f1f-1c6c-4ce7-9ebb-6c2ff15a876c None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:04.095607 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 16:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:04.100432 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf349-f003-4eb4-8ab6-e2323ae93991 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:04.100838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf349-f003-4eb4-8ab6-e2323ae93991 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:04.100978 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bf349-f003-4eb4-8ab6-e2323ae93991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:04.121617 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-497bf349-f003-4eb4-8ab6-e2323ae93991 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:04.122792 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-497bf349-f003-4eb4-8ab6-e2323ae93991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:04.130312 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 16:13:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:04.288121 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4f1f-1c6c-4ce7-9ebb-6c2ff15a876c None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:04.302018 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e4f1f-1c6c-4ce7-9ebb-6c2ff15a876c None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:04.309466 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670b085-306b-47b4-ac42-d350b3a8ebc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:04.310111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b085-306b-47b4-ac42-d350b3a8ebc0 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:04.310386 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b085-306b-47b4-ac42-d350b3a8ebc0 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:04.310653 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670b085-306b-47b4-ac42-d350b3a8ebc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:04.318990 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670b085-306b-47b4-ac42-d350b3a8ebc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:04.320576 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670b085-306b-47b4-ac42-d350b3a8ebc0 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:04.330444 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 573/1144] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:08.594616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfbd46-e527-4f7b-b7f9-6f42c678ff63 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:08.595168 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfbd46-e527-4f7b-b7f9-6f42c678ff63 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:08.595168 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfbd46-e527-4f7b-b7f9-6f42c678ff63 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:08.596487 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:08.601945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201578e5-62b5-40c3-a58b-f9448838db43 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:08.602369 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201578e5-62b5-40c3-a58b-f9448838db43 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:08.602494 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201578e5-62b5-40c3-a58b-f9448838db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:08.623870 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-201578e5-62b5-40c3-a58b-f9448838db43 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:08.626320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-201578e5-62b5-40c3-a58b-f9448838db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:08.639865 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:08.990081 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfbd46-e527-4f7b-b7f9-6f42c678ff63 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:08.991778 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-78cfbd46-e527-4f7b-b7f9-6f42c678ff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:09.048594 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfbd46-e527-4f7b-b7f9-6f42c678ff63 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:09.052057 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb8085-2e7d-4798-9782-d98d08e8b4fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:09.052641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb8085-2e7d-4798-9782-d98d08e8b4fb service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:09.052915 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb8085-2e7d-4798-9782-d98d08e8b4fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:09.053181 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb8085-2e7d-4798-9782-d98d08e8b4fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:09.062497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb8085-2e7d-4798-9782-d98d08e8b4fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:09.063911 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb8085-2e7d-4798-9782-d98d08e8b4fb service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:09.073672 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 573/1147] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:11.273961 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b2ce-6ebb-4532-98dd-b38208e40126 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:11.274523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b2ce-6ebb-4532-98dd-b38208e40126 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:11.274523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6b2ce-6ebb-4532-98dd-b38208e40126 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:11.276277 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:11.281682 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c075724-38fd-4e36-bdce-5ab123546d4b None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:11.282108 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c075724-38fd-4e36-bdce-5ab123546d4b None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:11.282232 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c075724-38fd-4e36-bdce-5ab123546d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:11.302441 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-2c075724-38fd-4e36-bdce-5ab123546d4b None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:11.304629 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-2c075724-38fd-4e36-bdce-5ab123546d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:11.313030 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:11.656677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6b2ce-6ebb-4532-98dd-b38208e40126 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:11.668539 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6b2ce-6ebb-4532-98dd-b38208e40126 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:11.672059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a37168-16c4-4b07-a1dc-5061deefc251 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:11.672647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37168-16c4-4b07-a1dc-5061deefc251 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:11.672923 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37168-16c4-4b07-a1dc-5061deefc251 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:11.673190 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a37168-16c4-4b07-a1dc-5061deefc251 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:11.681934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a37168-16c4-4b07-a1dc-5061deefc251 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:11.683974 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a37168-16c4-4b07-a1dc-5061deefc251 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:11.693212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 576/1150] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:15.435728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e801-5ba9-4b3f-b237-f9fcf3d36d86 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:15.436278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e801-5ba9-4b3f-b237-f9fcf3d36d86 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:15.436278 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e801-5ba9-4b3f-b237-f9fcf3d36d86 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:15.437601 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:15.442745 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928839d6-108b-4e49-977f-03754a95ded0 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:15.443165 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928839d6-108b-4e49-977f-03754a95ded0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:15.443278 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928839d6-108b-4e49-977f-03754a95ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:15.462667 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-928839d6-108b-4e49-977f-03754a95ded0 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:15.464725 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-928839d6-108b-4e49-977f-03754a95ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:15.472274 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:15 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:16.057470 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e801-5ba9-4b3f-b237-f9fcf3d36d86 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:16.059234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-03a6e801-5ba9-4b3f-b237-f9fcf3d36d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:16.115220 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e801-5ba9-4b3f-b237-f9fcf3d36d86 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:16.118714 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e48848-136e-48f2-b374-d470c2799fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738338255eae424ebc3ab73e2cf6b203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:16.119302 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48848-136e-48f2-b374-d470c2799fba service cinder] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:16.119810 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48848-136e-48f2-b374-d470c2799fba service cinder] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:16.119935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e48848-136e-48f2-b374-d470c2799fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:16.128515 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e48848-136e-48f2-b374-d470c2799fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:16.129965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e48848-136e-48f2-b374-d470c2799fba service cinder] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:16.140065 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 576/1153] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:18.333934 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c229-6e04-43d5-bae9-4563b4109411 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:18.334473 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c229-6e04-43d5-bae9-4563b4109411 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:18.334473 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1c229-6e04-43d5-bae9-4563b4109411 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:18.335715 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 16:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:13:18.341393 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac12e-128f-4dad-ab77-c062be8319b7 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:18.341853 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac12e-128f-4dad-ab77-c062be8319b7 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:18.341955 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac12e-128f-4dad-ab77-c062be8319b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:18.361352 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-6cbac12e-128f-4dad-ab77-c062be8319b7 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:13:18.362544 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-6cbac12e-128f-4dad-ab77-c062be8319b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:18.374059 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 16:13:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:13:18.955711 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1c229-6e04-43d5-bae9-4563b4109411 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:13:18.957419 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-8ca1c229-6e04-43d5-bae9-4563b4109411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:13:18.964824 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=70 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:18.971385 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1c229-6e04-43d5-bae9-4563b4109411 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:13:18.974880 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce759d-0198-486d-8711-890051d4e1f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738338255eae424ebc3ab73e2cf6b203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:13:18.975471 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce759d-0198-486d-8711-890051d4e1f2 service cinder] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:13:18.975743 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce759d-0198-486d-8711-890051d4e1f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:13:18.976008 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce759d-0198-486d-8711-890051d4e1f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:13:18.986091 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce759d-0198-486d-8711-890051d4e1f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:13:18.987511 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce759d-0198-486d-8711-890051d4e1f2 service cinder] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:13:18.997809 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 579/1156] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:13:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:13:28.356226 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=70 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:13:28.992734 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=5 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:34.882163 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd09ab-b59c-42d1-aca7-ada203e440fa None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:34.882802 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd09ab-b59c-42d1-aca7-ada203e440fa None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:34.882802 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd09ab-b59c-42d1-aca7-ada203e440fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:34.887191 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1f94-e5fc-4691-a926-84409b59e908 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:34.887642 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1f94-e5fc-4691-a926-84409b59e908 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:34.887742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a1f94-e5fc-4691-a926-84409b59e908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:34.902550 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-b5cd09ab-b59c-42d1-aca7-ada203e440fa None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:34.904020 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b5cd09ab-b59c-42d1-aca7-ada203e440fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:34.906763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-372a1f94-e5fc-4691-a926-84409b59e908 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:34.907949 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-372a1f94-e5fc-4691-a926-84409b59e908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:34.916870 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 578/1157] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:34.919001 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 580/1158] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:34.925290 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894671-8710-40a9-92f2-9d7f78b3e786 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:34.925609 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894671-8710-40a9-92f2-9d7f78b3e786 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:34.925775 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2e2c0-ece9-4c27-b9e2-fbeca3b6b4f6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:34.925889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43894671-8710-40a9-92f2-9d7f78b3e786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:34.926058 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2e2c0-ece9-4c27-b9e2-fbeca3b6b4f6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:34.926333 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2e2c0-ece9-4c27-b9e2-fbeca3b6b4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:34.945485 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-cdc2e2c0-ece9-4c27-b9e2-fbeca3b6b4f6 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:34.945684 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-43894671-8710-40a9-92f2-9d7f78b3e786 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:34.946676 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-43894671-8710-40a9-92f2-9d7f78b3e786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:34.946801 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-cdc2e2c0-ece9-4c27-b9e2-fbeca3b6b4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:34.954481 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 579/1159] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:14:34.956693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 581/1160] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:14:34.958974 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894671-8710-40a9-92f2-9d7f78b3e786 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:34.959111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2e2c0-ece9-4c27-b9e2-fbeca3b6b4f6 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:34.968473 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43894671-8710-40a9-92f2-9d7f78b3e786 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:34.968722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2e2c0-ece9-4c27-b9e2-fbeca3b6b4f6 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:34.972988 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:34.973465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:34.973598 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:34.973923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:34.974077 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:34.974172 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] PATH_INFO: `/v3/domains` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:34.974325 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:34.974595 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:34.974797 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88432) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:14:34.975098 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:34.975347 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88431) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 16:14:34.975651 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:34.976654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:14:34.976654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 17 16:14:34.976654 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: Aug 17 16:14:34.976912 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:34.977553 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:34.990420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 580/1161] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 17 16:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:14:34.994309 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 582/1162] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 17 16:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 16:14:34.998130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.002378 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.007888 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc5007e-9100-460f-b376-faacd18ff537 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.012431 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.012751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c7397-0c42-47b7-813f-b1dd9879d5a5 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.013014 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.013291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.013602 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.014219 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.015270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:14:35.015270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 17 16:14:35.015270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: Aug 17 16:14:35.016446 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.017377 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.017966 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.018247 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.018519 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.019135 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.021009 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.054811 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 581/1163] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 17 16:14:34 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:14:35.061256 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 583/1164] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 17 16:14:35 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:14:35.061434 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.062271 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.120642 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8254ce-72d8-4e3d-ac59-1590adfdcee7 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.124905 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb28224-d0c7-4683-875d-ffddc07dc03b admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.125286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.125916 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.126195 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.126467 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.127076 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.128976 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.129778 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.130186 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.130469 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.130741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.131349 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.132408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: WARNING py.warnings [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:14:35.132408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: warnings.warn(msg) Aug 17 16:14:35.132408 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: Aug 17 16:14:35.133565 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.153347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 582/1165] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:14:35 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:14:35.156547 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 584/1166] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:14:35 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:14:35.157087 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.160334 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.167420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a91db5-80a9-451e-acc3-fe9c649e91eb admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.170184 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66ed1-7121-424b-8aaa-b7f63b220c56 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.171905 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.172485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.172760 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.173022 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.173678 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.174836 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.175252 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.175474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.175752 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.176023 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.176656 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.178321 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.186531 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 583/1167] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:14:35.190573 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.192844 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 585/1168] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:14:35.196671 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.201361 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773b5fd-63b4-48fb-b367-be826e6970a8 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.206848 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.207424 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.207841 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.208151 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.208666 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a62ce-086c-4363-a915-8a47d837d07b admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.208850 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.211222 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.214465 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.215080 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.215392 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.215668 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.216311 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.218019 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.223638 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 584/1169] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:14:35.227841 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.234111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 586/1170] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:14:35.235231 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.239257 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4092cb-314f-4f04-b8d7-555acec980b4 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.244009 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543ec06-4937-42e9-a027-ba9c0192f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.244958 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543ec06-4937-42e9-a027-ba9c0192f5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.245089 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8816-448f-46bd-8965-43aeee82d2da admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.245194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543ec06-4937-42e9-a027-ba9c0192f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.245458 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543ec06-4937-42e9-a027-ba9c0192f5ab admin admin] PATH_INFO: `/v3/projects/e549d71c421e49a5ba8af403f82bb900/users/a87f7d1d1b074ef9a67f6bffc273c8e7/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.250652 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a45b2-10e7-4915-b1cb-b78b691c0057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.251288 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a45b2-10e7-4915-b1cb-b78b691c0057 admin admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.251563 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a45b2-10e7-4915-b1cb-b78b691c0057 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.251831 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a45b2-10e7-4915-b1cb-b78b691c0057 admin admin] PATH_INFO: `/v3/projects/fc255fcabea342ee9e0dcca985cac63f/users/572057fc5af44b4fa2fccbe247fa775a/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.259728 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543ec06-4937-42e9-a027-ba9c0192f5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e549d71c421e49a5ba8af403f82bb900, user_id=a87f7d1d1b074ef9a67f6bffc273c8e7, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.260855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: WARNING py.warnings [None req-0543ec06-4937-42e9-a027-ba9c0192f5ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 16:14:35.260855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: warnings.warn(msg) Aug 17 16:14:35.260855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: Aug 17 16:14:35.262813 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543ec06-4937-42e9-a027-ba9c0192f5ab admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.266639 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a45b2-10e7-4915-b1cb-b78b691c0057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc255fcabea342ee9e0dcca985cac63f, user_id=572057fc5af44b4fa2fccbe247fa775a, role_id=dc415a6dbb0548b3a1e1ab3cc4b3b267)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.269351 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a45b2-10e7-4915-b1cb-b78b691c0057 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.278448 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 585/1171] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 17 16:14:35 2022] PUT /identity/v3/projects/e549d71c421e49a5ba8af403f82bb900/users/a87f7d1d1b074ef9a67f6bffc273c8e7/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:14:35.282304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 587/1172] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 17 16:14:35 2022] PUT /identity/v3/projects/fc255fcabea342ee9e0dcca985cac63f/users/572057fc5af44b4fa2fccbe247fa775a/roles/dc415a6dbb0548b3a1e1ab3cc4b3b267 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:14:35.283560 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f6a8-d652-4743-85b5-a67a96843cac None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.283845 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f6a8-d652-4743-85b5-a67a96843cac None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.284119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1f6a8-d652-4743-85b5-a67a96843cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.287180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.287468 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.287742 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.302989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-19d1f6a8-d652-4743-85b5-a67a96843cac None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:35.304186 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-19d1f6a8-d652-4743-85b5-a67a96843cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:35.306039 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] MFA Rules not processed for user `3a6faffef1254eafa180a1020d50a19a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:35.307879 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:35.349976 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:35.354871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:35.370736 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 586/1173] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:14:35.374795 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 588/1174] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:14:35.380958 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f6a8-d652-4743-85b5-a67a96843cac None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.385194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:35.387194 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:35.440565 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1f6a8-d652-4743-85b5-a67a96843cac None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.444377 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa297e-1afb-4987-a7c4-9a677b60a0ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.445112 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa297e-1afb-4987-a7c4-9a677b60a0ba service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.445420 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa297e-1afb-4987-a7c4-9a677b60a0ba service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.445694 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa297e-1afb-4987-a7c4-9a677b60a0ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.455703 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa297e-1afb-4987-a7c4-9a677b60a0ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.457130 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa297e-1afb-4987-a7c4-9a677b60a0ba service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.458326 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf2ea8-4840-444c-b0ad-6ebc523fd227 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:35.461903 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:35.462500 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:35.462773 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:35.463066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:35.467427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 587/1175] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:14:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:14:35.472802 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:35.474258 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:35.484573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 589/1176] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:14:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:14:41.950892 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e30ad-2f63-4754-aedc-0bde600a5fce None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:41.951836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e30ad-2f63-4754-aedc-0bde600a5fce None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:41.952265 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e30ad-2f63-4754-aedc-0bde600a5fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:41.999225 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-bc7e30ad-2f63-4754-aedc-0bde600a5fce None None] MFA Rules not processed for user `a87f7d1d1b074ef9a67f6bffc273c8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:42.000471 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-bc7e30ad-2f63-4754-aedc-0bde600a5fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:42.125690 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 588/1177] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:41 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:14:42.129785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.160710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f7e39-cc39-4699-9d00-5ee1534fa6e9 service neutron] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.170604 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.171224 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.171496 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.172127 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] PATH_INFO: `/v3/projects` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.173100 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.182440 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.194510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0bebf-4253-4619-855b-2689f4c5f015 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.194923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0bebf-4253-4619-855b-2689f4c5f015 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.195338 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0bebf-4253-4619-855b-2689f4c5f015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.237953 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 590/1178] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 17 16:14:42 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:14:42.241553 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3ce0bebf-4253-4619-855b-2689f4c5f015 None None] MFA Rules not processed for user `572057fc5af44b4fa2fccbe247fa775a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:42.241694 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.242243 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3ce0bebf-4253-4619-855b-2689f4c5f015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:42.321763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727bc439-b042-4a3a-ad57-474c16565c91 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.330350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.332368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.332368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.332368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] PATH_INFO: `/v3/users` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.332368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.334896 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.335752 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 589/1179] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:42 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:42.341206 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0bebf-4253-4619-855b-2689f4c5f015 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.358861 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0bebf-4253-4619-855b-2689f4c5f015 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.366505 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.367307 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.367597 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.367852 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] PATH_INFO: `/v3/projects` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.368479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.375354 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 591/1180] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:14:42 2022] POST /identity/v3/users => generated 299 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 16:14:42.375584 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.383621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.392547 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:42.409926 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e553b-6a13-451a-bd8b-e5e768edad30 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.415856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.417350 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.417798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.418238 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.419048 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.422216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.442669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 592/1181] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:14:42.443719 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.453459 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 590/1182] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 17 16:14:42 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:14:42.454366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.455932 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348f38f-5ade-4303-91e1-2213ffe18860 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.514372 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:42.560724 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.562504 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.562788 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.563059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] PATH_INFO: `/v3/projects/7046b9cf26624144902873c4682814f4/users/bb52f4d6f5da47e49b016be9deb9dd3f/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.576862 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0794866-4ac9-448c-bf12-9cebfdf9138d admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.581201 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7046b9cf26624144902873c4682814f4, user_id=bb52f4d6f5da47e49b016be9deb9dd3f, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.583974 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.588497 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.588989 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.589373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.590023 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] PATH_INFO: `/v3/users` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.593990 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.595947 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.614638 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 593/1183] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 17 16:14:42 2022] PUT /identity/v3/projects/7046b9cf26624144902873c4682814f4/users/bb52f4d6f5da47e49b016be9deb9dd3f/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:14:42.621798 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.638203 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 591/1184] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 17 16:14:42 2022] POST /identity/v3/users => generated 296 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 16:14:42.642254 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.665758 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b58673-daa9-4fc8-a991-af16faff6b46 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.738053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a3e8c-4d17-4443-9f7e-71a1cd6cb90d admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.753785 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.754572 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.754854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.755123 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.755763 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.760395 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.788727 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 594/1185] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 16:14:42.793580 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.795479 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.796113 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.796378 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.796634 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] PATH_INFO: `/v3/roles` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.797273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.798919 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.815510 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793c57e-7aa2-47ae-9a92-158c484dd31d admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.825455 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 592/1186] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:14:42.826356 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:42.831276 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.833487 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.834724 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.835791 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] PATH_INFO: `/v3/projects/7046b9cf26624144902873c4682814f4/users/bb52f4d6f5da47e49b016be9deb9dd3f/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.839255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f689c6-0046-4a16-9f84-d61c3827c378 admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:42.844478 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:42.845537 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:42.845800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:42.845940 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7046b9cf26624144902873c4682814f4, user_id=bb52f4d6f5da47e49b016be9deb9dd3f, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.846294 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] PATH_INFO: `/v3/projects/253326043068470b8bd683dac1202b26/users/c270b8246380472cadd5da9610028531/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:42.850167 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.866309 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 595/1187] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 17 16:14:42 2022] PUT /identity/v3/projects/7046b9cf26624144902873c4682814f4/users/bb52f4d6f5da47e49b016be9deb9dd3f/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:14:42.886631 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] RBAC: Authorizing `identity:create_grant(project_id=253326043068470b8bd683dac1202b26, user_id=c270b8246380472cadd5da9610028531, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:42.891437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:42.918561 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 593/1188] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 17 16:14:42 2022] PUT /identity/v3/projects/253326043068470b8bd683dac1202b26/users/c270b8246380472cadd5da9610028531/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:14:42.919621 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:43.028365 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30436d-ac99-49fc-b4cd-df6df5adc4e3 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:43.131180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:43.156741 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2081d2e3-fac7-4950-9a4d-c80047721d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:43.158010 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081d2e3-fac7-4950-9a4d-c80047721d22 admin admin] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:43.158810 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081d2e3-fac7-4950-9a4d-c80047721d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:43.159564 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2081d2e3-fac7-4950-9a4d-c80047721d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:43.160884 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081d2e3-fac7-4950-9a4d-c80047721d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:43.163460 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2081d2e3-fac7-4950-9a4d-c80047721d22 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:43.187122 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 596/1189] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 17 16:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 16:14:43.191084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:43.207336 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65eb58a-4261-445e-9fe8-e8c15298059b admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:43.232500 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02d68c-0f01-4711-a8b5-9ccb8dd04449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:43.232966 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d68c-0f01-4711-a8b5-9ccb8dd04449 admin admin] REQUEST_METHOD: `PUT` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:43.233246 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d68c-0f01-4711-a8b5-9ccb8dd04449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:43.233554 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02d68c-0f01-4711-a8b5-9ccb8dd04449 admin admin] PATH_INFO: `/v3/projects/253326043068470b8bd683dac1202b26/users/c270b8246380472cadd5da9610028531/roles/8aaf0e0acac14fb88e179fd18d9eaaab` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:43.235916 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d68c-0f01-4711-a8b5-9ccb8dd04449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253326043068470b8bd683dac1202b26, user_id=c270b8246380472cadd5da9610028531, role_id=8aaf0e0acac14fb88e179fd18d9eaaab)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:43.242916 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02d68c-0f01-4711-a8b5-9ccb8dd04449 admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:43.276721 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 594/1190] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 17 16:14:43 2022] PUT /identity/v3/projects/253326043068470b8bd683dac1202b26/users/c270b8246380472cadd5da9610028531/roles/8aaf0e0acac14fb88e179fd18d9eaaab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:14:49.872945 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:49.873872 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:49.874503 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:49.910271 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:49.910724 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:49.910828 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:49.918959 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] MFA Rules not processed for user `c270b8246380472cadd5da9610028531`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:49.920598 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:49.943970 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] MFA Rules not processed for user `bb52f4d6f5da47e49b016be9deb9dd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:49.945203 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:49.985212 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:50.040567 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 597/1191] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:49 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:50.051195 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 595/1192] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:49 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:50.057596 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:50.059257 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:50.064149 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:50.065608 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:50.145434 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617069d7-e029-46d6-b518-1b0bfb2ed9a8 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:50.152013 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ec971-7168-4106-8d0a-534316e30ecb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c222aec3576b436b8bfcef46f12751ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:50.152669 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec971-7168-4106-8d0a-534316e30ecb service glance] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:50.152943 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec971-7168-4106-8d0a-534316e30ecb service glance] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:50.153209 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ec971-7168-4106-8d0a-534316e30ecb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:50.155291 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879ef47-9b49-4288-b3a2-aa87d936bcc3 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:50.159234 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb75ff7-186f-44e6-9bc2-71eb1beff7c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c222aec3576b436b8bfcef46f12751ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:50.159920 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb75ff7-186f-44e6-9bc2-71eb1beff7c1 service glance] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:50.160270 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb75ff7-186f-44e6-9bc2-71eb1beff7c1 service glance] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:50.160612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb75ff7-186f-44e6-9bc2-71eb1beff7c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:50.226876 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb75ff7-186f-44e6-9bc2-71eb1beff7c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:50.229118 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb75ff7-186f-44e6-9bc2-71eb1beff7c1 service glance] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:50.229640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ec971-7168-4106-8d0a-534316e30ecb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:50.231087 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57ec971-7168-4106-8d0a-534316e30ecb service glance] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:50.239339 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 596/1193] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:14:50 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:14:50.241550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 598/1194] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:14:50 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:14:58.295589 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981b6d0-224d-4f4e-b722-ca211a6356e2 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:58.297710 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981b6d0-224d-4f4e-b722-ca211a6356e2 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:58.297991 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981b6d0-224d-4f4e-b722-ca211a6356e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:58.347454 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-a981b6d0-224d-4f4e-b722-ca211a6356e2 None None] MFA Rules not processed for user `a87f7d1d1b074ef9a67f6bffc273c8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:58.350200 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a981b6d0-224d-4f4e-b722-ca211a6356e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:58.370790 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 597/1195] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:14:58 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:58.767209 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca6d01-b25b-4606-9845-f82d560035d5 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:58.767703 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca6d01-b25b-4606-9845-f82d560035d5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:58.767796 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca6d01-b25b-4606-9845-f82d560035d5 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:58.769578 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 599/1196] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 17 16:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:14:58.783272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dc761-4d2a-4837-9e78-4fe11ccc13be None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:58.783659 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dc761-4d2a-4837-9e78-4fe11ccc13be None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:58.784073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8dc761-4d2a-4837-9e78-4fe11ccc13be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:58.870281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-3f8dc761-4d2a-4837-9e78-4fe11ccc13be None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:58.871368 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-3f8dc761-4d2a-4837-9e78-4fe11ccc13be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:58.941600 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=100 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:58.982965 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 598/1197] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 17 16:14:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:58.991358 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff5a9-4d54-417b-94f9-44423ee2d247 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:58.991935 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff5a9-4d54-417b-94f9-44423ee2d247 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:58.992282 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fff5a9-4d54-417b-94f9-44423ee2d247 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:58.994513 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 600/1198] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 17 16:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:14:59.000121 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200322ba-c8d7-4ac4-91ac-9bd8d52d6c29 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:59.003630 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200322ba-c8d7-4ac4-91ac-9bd8d52d6c29 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:59.004329 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200322ba-c8d7-4ac4-91ac-9bd8d52d6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:59.035259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-200322ba-c8d7-4ac4-91ac-9bd8d52d6c29 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:59.037582 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-200322ba-c8d7-4ac4-91ac-9bd8d52d6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:59.049162 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 599/1199] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 17 16:14:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:59.063193 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fff5a9-4d54-417b-94f9-44423ee2d247 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:59.081640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fff5a9-4d54-417b-94f9-44423ee2d247 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:59.086058 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0687f-d84c-493a-b5dd-b4abd503ed7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c222aec3576b436b8bfcef46f12751ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:59.086928 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0687f-d84c-493a-b5dd-b4abd503ed7e service glance] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:59.088069 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0687f-d84c-493a-b5dd-b4abd503ed7e service glance] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:59.088211 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0687f-d84c-493a-b5dd-b4abd503ed7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:59.107838 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0687f-d84c-493a-b5dd-b4abd503ed7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:59.109366 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0687f-d84c-493a-b5dd-b4abd503ed7e service glance] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:59.115999 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=100 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:14:59.122689 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 601/1200] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:14:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:14:59.567121 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281457c-ac3a-4c94-b413-c060620d8f85 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:59.568090 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281457c-ac3a-4c94-b413-c060620d8f85 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:59.568427 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281457c-ac3a-4c94-b413-c060620d8f85 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:59.570244 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 600/1201] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 17 16:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:14:59.579201 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2548-8d71-4fdf-a6a4-bd50d1a22b0b None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:59.579614 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2548-8d71-4fdf-a6a4-bd50d1a22b0b None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:59.579976 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e2548-8d71-4fdf-a6a4-bd50d1a22b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:59.607023 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d41e2548-8d71-4fdf-a6a4-bd50d1a22b0b None None] MFA Rules not processed for user `30a70853ec1d420b9533cf1d056e170b`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:14:59.608426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d41e2548-8d71-4fdf-a6a4-bd50d1a22b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:14:59.677596 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 602/1202] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 17 16:14:59 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:14:59.686386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281457c-ac3a-4c94-b413-c060620d8f85 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:14:59.699543 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281457c-ac3a-4c94-b413-c060620d8f85 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:14:59.703741 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fb1a50-cdcc-4153-84d5-eb2a6d781d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:14:59.704538 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb1a50-cdcc-4153-84d5-eb2a6d781d54 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:14:59.704818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb1a50-cdcc-4153-84d5-eb2a6d781d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:14:59.705088 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fb1a50-cdcc-4153-84d5-eb2a6d781d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:14:59.714066 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb1a50-cdcc-4153-84d5-eb2a6d781d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:14:59.715493 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fb1a50-cdcc-4153-84d5-eb2a6d781d54 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:14:59.724639 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 601/1203] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:14:59 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:00.269942 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aefe8-5285-4616-b42b-ba820ff5179a None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.270573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aefe8-5285-4616-b42b-ba820ff5179a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.270854 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8aefe8-5285-4616-b42b-ba820ff5179a None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.274141 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 603/1204] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 17 16:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:00.279677 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d077f-5b0c-4c1c-b37e-aef996c34b5f None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.280029 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d077f-5b0c-4c1c-b37e-aef996c34b5f None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.280302 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d077f-5b0c-4c1c-b37e-aef996c34b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.301514 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c87d077f-5b0c-4c1c-b37e-aef996c34b5f None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:00.302747 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c87d077f-5b0c-4c1c-b37e-aef996c34b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:00.307396 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6e577-bc75-43ed-883c-224ecea7b5ad None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.307710 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6e577-bc75-43ed-883c-224ecea7b5ad None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.307985 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc6e577-bc75-43ed-883c-224ecea7b5ad None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.309368 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 604/1205] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 17 16:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:15:00.312022 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 602/1206] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 17 16:15:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:00.315034 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398991-0a9d-48c6-96d1-274ab5ffadac None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.315317 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398991-0a9d-48c6-96d1-274ab5ffadac None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.315593 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4398991-0a9d-48c6-96d1-274ab5ffadac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.317724 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f80c-6a9f-4a0c-8e03-c0ea80f17941 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.318000 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f80c-6a9f-4a0c-8e03-c0ea80f17941 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.318273 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455f80c-6a9f-4a0c-8e03-c0ea80f17941 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.319501 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 603/1207] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 17 16:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:00.324662 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04673-a34c-4e1d-b484-9da742c685d8 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.324936 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04673-a34c-4e1d-b484-9da742c685d8 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.325309 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04673-a34c-4e1d-b484-9da742c685d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.338175 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-a4398991-0a9d-48c6-96d1-274ab5ffadac None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:00.339484 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a4398991-0a9d-48c6-96d1-274ab5ffadac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:00.350311 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-c5b04673-a34c-4e1d-b484-9da742c685d8 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:00.351855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-c5b04673-a34c-4e1d-b484-9da742c685d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:00.361106 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 604/1208] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 17 16:15:00 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:00.372855 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04673-a34c-4e1d-b484-9da742c685d8 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:00.382145 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04673-a34c-4e1d-b484-9da742c685d8 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:00.386586 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:00.387189 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.387463 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.387735 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.398007 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:00.399417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:00.410532 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 605/1209] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:00.418470 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 605/1210] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 17 16:15:00 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:00.425923 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:00.438957 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397fca8-9cc2-4cf7-8d42-3da648c27196 service neutron] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:00.449184 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6772c5cbd29741078f90ea0aadb2ddbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:00.449836 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:00.450115 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:00.450379 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:00.452992 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:00.468084 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:00.469688 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:00.480072 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 606/1211] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:00 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:10.406360 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=52 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:10.475471 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=35 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:10.619254 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109272b6-12d6-4d15-a163-69538ada3322 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:10.619624 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109272b6-12d6-4d15-a163-69538ada3322 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:10.619901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109272b6-12d6-4d15-a163-69538ada3322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:10.640305 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-109272b6-12d6-4d15-a163-69538ada3322 None None] MFA Rules not processed for user `30a70853ec1d420b9533cf1d056e170b`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:10.641535 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-109272b6-12d6-4d15-a163-69538ada3322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:10.648416 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 606/1212] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Aug 17 16:15:10 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 16:15:10.660720 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:10.671218 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac89538-f1fe-4b00-9107-065ae5d55af7 service placement] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:10.675423 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa21fb-ee1f-47bf-959a-ca1a38b66584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:10.676210 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa21fb-ee1f-47bf-959a-ca1a38b66584 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:10.676490 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa21fb-ee1f-47bf-959a-ca1a38b66584 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:10.676770 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa21fb-ee1f-47bf-959a-ca1a38b66584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:10.685864 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa21fb-ee1f-47bf-959a-ca1a38b66584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:10.687281 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa21fb-ee1f-47bf-959a-ca1a38b66584 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:10.695024 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 607/1213] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:10 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:11.405279 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c21b0-1294-47a1-a44d-820b6f57b0f0 None None] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:11.405888 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c21b0-1294-47a1-a44d-820b6f57b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:11.406161 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499c21b0-1294-47a1-a44d-820b6f57b0f0 None None] PATH_INFO: `/` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:11.407540 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 607/1214] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 17 16:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:11.455667 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff0ea-a645-43ef-9820-f52658b52a43 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:11.456233 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff0ea-a645-43ef-9820-f52658b52a43 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:11.456509 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff0ea-a645-43ef-9820-f52658b52a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:11.476617 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-f4bff0ea-a645-43ef-9820-f52658b52a43 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:11.477380 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-f4bff0ea-a645-43ef-9820-f52658b52a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:11.486924 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 608/1215] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 17 16:15:11 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:11.509023 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c21b0-1294-47a1-a44d-820b6f57b0f0 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:11.523670 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499c21b0-1294-47a1-a44d-820b6f57b0f0 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:11.528938 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e45d04-3ac2-46a9-a18d-f4abadd7d59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:11.529573 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45d04-3ac2-46a9-a18d-f4abadd7d59f service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:11.529849 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45d04-3ac2-46a9-a18d-f4abadd7d59f service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:11.530115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45d04-3ac2-46a9-a18d-f4abadd7d59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:11.550647 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e45d04-3ac2-46a9-a18d-f4abadd7d59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:11.552249 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e45d04-3ac2-46a9-a18d-f4abadd7d59f service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:11.563821 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 608/1216] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:17.065294 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a14e-8431-450b-8f18-d53622ca4db6 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:17.065952 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a14e-8431-450b-8f18-d53622ca4db6 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:17.065952 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50a14e-8431-450b-8f18-d53622ca4db6 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:17.067874 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 609/1217] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 17 16:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:17.080295 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1d0a-0f7c-4930-b70d-91d939e19997 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:17.080866 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1d0a-0f7c-4930-b70d-91d939e19997 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:17.080866 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b1d0a-0f7c-4930-b70d-91d939e19997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:17.108856 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-611b1d0a-0f7c-4930-b70d-91d939e19997 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:17.110707 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-611b1d0a-0f7c-4930-b70d-91d939e19997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:17.122525 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 609/1218] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 17 16:15:17 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:17.136194 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a14e-8431-450b-8f18-d53622ca4db6 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:17.153467 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50a14e-8431-450b-8f18-d53622ca4db6 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:17.158782 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8b0bf-ddac-4425-aed3-851bdeef237e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:17.159384 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b0bf-ddac-4425-aed3-851bdeef237e service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:17.159658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b0bf-ddac-4425-aed3-851bdeef237e service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:17.159921 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8b0bf-ddac-4425-aed3-851bdeef237e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:17.171935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8b0bf-ddac-4425-aed3-851bdeef237e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:17.171935 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8b0bf-ddac-4425-aed3-851bdeef237e service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:17.183146 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 610/1219] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:17 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:27.102263 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=12 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:27.178153 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=15 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:29.456622 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1d0a-0f7c-4930-b70d-91d939e19997 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:29.466883 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b1d0a-0f7c-4930-b70d-91d939e19997 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:29.470496 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04985f3a-95d5-44b9-b7ee-b859f014efbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:29.471088 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985f3a-95d5-44b9-b7ee-b859f014efbc service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:29.471357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985f3a-95d5-44b9-b7ee-b859f014efbc service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:29.471619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985f3a-95d5-44b9-b7ee-b859f014efbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:29.480975 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04985f3a-95d5-44b9-b7ee-b859f014efbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:29.482430 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04985f3a-95d5-44b9-b7ee-b859f014efbc service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:29.492115 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 610/1220] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:29 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:33.784985 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e82c-21f0-4d6a-b842-0af5cd0d0263 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.786061 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e82c-21f0-4d6a-b842-0af5cd0d0263 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.786529 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7e82c-21f0-4d6a-b842-0af5cd0d0263 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.790059 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 611/1221] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 17 16:15:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 16:15:33.842040 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9ec3-481d-42a7-95ec-0f404ca96a76 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.842637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9ec3-481d-42a7-95ec-0f404ca96a76 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.842637 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db9ec3-481d-42a7-95ec-0f404ca96a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.876163 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-89db9ec3-481d-42a7-95ec-0f404ca96a76 None None] MFA Rules not processed for user `ae7640a3956e449ebeb41f45eb56aeda`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:33.877772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-89db9ec3-481d-42a7-95ec-0f404ca96a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:33.887877 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 611/1222] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 17 16:15:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:33.911288 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e82c-21f0-4d6a-b842-0af5cd0d0263 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:33.927799 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7e82c-21f0-4d6a-b842-0af5cd0d0263 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:33.934362 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b2394-c596-4c83-a497-383add48aad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:33.935255 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2394-c596-4c83-a497-383add48aad9 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:33.935872 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2394-c596-4c83-a497-383add48aad9 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:33.936396 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b2394-c596-4c83-a497-383add48aad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:33.946114 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b2394-c596-4c83-a497-383add48aad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:33.948917 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b2394-c596-4c83-a497-383add48aad9 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:33.966818 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 612/1223] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:15:43.869779 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=9 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:43.956347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=6 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:15:49.955285 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f714-2829-4eb7-af20-f2beb1b1a83a None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:49.955855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f714-2829-4eb7-af20-f2beb1b1a83a None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:49.955855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863f714-2829-4eb7-af20-f2beb1b1a83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:49.974222 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-c863f714-2829-4eb7-af20-f2beb1b1a83a None None] MFA Rules not processed for user `572057fc5af44b4fa2fccbe247fa775a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:49.975405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-c863f714-2829-4eb7-af20-f2beb1b1a83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:49.983323 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 612/1224] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:15:49 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:50.301507 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73538e-9a3f-4a63-94ce-b2581560949a None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73538e-9a3f-4a63-94ce-b2581560949a None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.302050 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73538e-9a3f-4a63-94ce-b2581560949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.321490 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-0e73538e-9a3f-4a63-94ce-b2581560949a None None] MFA Rules not processed for user `30a70853ec1d420b9533cf1d056e170b`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:15:50.323625 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-0e73538e-9a3f-4a63-94ce-b2581560949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:15:50.329984 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 613/1225] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 17 16:15:50 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:15:50.341441 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863f714-2829-4eb7-af20-f2beb1b1a83a None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:15:50.350620 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c863f714-2829-4eb7-af20-f2beb1b1a83a None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:15:50.354472 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39734f0-2d28-44c2-99dd-336865478812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:15:50.355059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39734f0-2d28-44c2-99dd-336865478812 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:15:50.355329 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39734f0-2d28-44c2-99dd-336865478812 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:15:50.355592 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39734f0-2d28-44c2-99dd-336865478812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:15:50.362426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39734f0-2d28-44c2-99dd-336865478812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:15:50.363831 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39734f0-2d28-44c2-99dd-336865478812 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:15:50.371768 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 613/1226] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:15:50 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:16:00.316889 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:00.367996 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=9 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:14.944950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742a2c-e059-4c09-a976-5861ec923d00 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:14.945413 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742a2c-e059-4c09-a976-5861ec923d00 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:14.945516 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea742a2c-e059-4c09-a976-5861ec923d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:14.964703 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ea742a2c-e059-4c09-a976-5861ec923d00 None None] MFA Rules not processed for user `572057fc5af44b4fa2fccbe247fa775a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:14.965950 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ea742a2c-e059-4c09-a976-5861ec923d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:14.972800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 614/1227] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:16:14 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:24.960010 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:16:29.535663 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4659-77c9-4630-9e08-175600dda0f5 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:16:29.536216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4659-77c9-4630-9e08-175600dda0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:16:29.536216 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f4659-77c9-4630-9e08-175600dda0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:16:29.555255 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-d98f4659-77c9-4630-9e08-175600dda0f5 None None] MFA Rules not processed for user `572057fc5af44b4fa2fccbe247fa775a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:16:29.556447 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-d98f4659-77c9-4630-9e08-175600dda0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:16:29.563916 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 614/1228] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:16:29 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:16:39.550493 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:26.795132 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3378f4-8fcc-4843-8da0-7509e0cd6778 None None] REQUEST_METHOD: `POST` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:26.795623 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3378f4-8fcc-4843-8da0-7509e0cd6778 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:26.795709 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3378f4-8fcc-4843-8da0-7509e0cd6778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:26.816374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.auth.core [None req-ec3378f4-8fcc-4843-8da0-7509e0cd6778 None None] MFA Rules not processed for user `572057fc5af44b4fa2fccbe247fa775a`. Rule list: `[]` (Enabled: `True`). {{(pid=88432) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:17:26.817606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-ec3378f4-8fcc-4843-8da0-7509e0cd6778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:17:26.825263 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 615/1229] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:17:26 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:17:36.811560 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=3 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:17:38.379474 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f4659-77c9-4630-9e08-175600dda0f5 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:17:38.398535 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f4659-77c9-4630-9e08-175600dda0f5 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:17:38.402375 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a181f-def9-4f60-ae30-7f4e196b213f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:17:38.402967 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a181f-def9-4f60-ae30-7f4e196b213f service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:17:38.403245 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a181f-def9-4f60-ae30-7f4e196b213f service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:17:38.403516 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a181f-def9-4f60-ae30-7f4e196b213f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:17:38.412297 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a181f-def9-4f60-ae30-7f4e196b213f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:17:38.413764 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a181f-def9-4f60-ae30-7f4e196b213f service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:17:38.423705 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 615/1230] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:17:38 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:17:48.419575 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=10 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:03.063485 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3378f4-8fcc-4843-8da0-7509e0cd6778 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:03.084358 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3378f4-8fcc-4843-8da0-7509e0cd6778 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:03.089160 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6772c5cbd29741078f90ea0aadb2ddbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:03.089809 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:03.090078 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:03.090341 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:03.098600 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:03.100151 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:03.109803 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 616/1231] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:03 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:19:13.105692 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=10 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:23.227458 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb81d2-1dd9-4f08-b955-622877aad285 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:23.227952 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb81d2-1dd9-4f08-b955-622877aad285 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:23.228053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb81d2-1dd9-4f08-b955-622877aad285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:23.247871 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-bcdb81d2-1dd9-4f08-b955-622877aad285 None None] MFA Rules not processed for user `a87f7d1d1b074ef9a67f6bffc273c8e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:23.249730 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bcdb81d2-1dd9-4f08-b955-622877aad285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:23.257212 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 616/1232] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:19:23 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:33.243111 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=3 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:48.601364 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:48.617797 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb81d2-1dd9-4f08-b955-622877aad285 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:19:48.631585 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb81d2-1dd9-4f08-b955-622877aad285 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:48.635304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5da0d4c-1bc0-4526-9f77-1cb7796c484b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:48.635938 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0d4c-1bc0-4526-9f77-1cb7796c484b service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:48.636215 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0d4c-1bc0-4526-9f77-1cb7796c484b service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:48.636633 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5da0d4c-1bc0-4526-9f77-1cb7796c484b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:48.657783 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da0d4c-1bc0-4526-9f77-1cb7796c484b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:48.659340 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5da0d4c-1bc0-4526-9f77-1cb7796c484b service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:48.683917 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 617/1233] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:48 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 16:19:48.709525 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b395444-e114-4b90-a88c-a860dc251337 service placement] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:19:48.713975 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '738338255eae424ebc3ab73e2cf6b203', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:19:48.715267 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:48.715840 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:48.716258 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:48.727347 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:19:48.729269 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:19:48.742612 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 617/1234] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:19:48 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:19:49.581729 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccd98b-0038-47d2-aa03-6ffcb8ae7825 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:19:49.582009 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccd98b-0038-47d2-aa03-6ffcb8ae7825 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:19:49.582496 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccd98b-0038-47d2-aa03-6ffcb8ae7825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:19:49.602799 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-0fccd98b-0038-47d2-aa03-6ffcb8ae7825 None None] MFA Rules not processed for user `572057fc5af44b4fa2fccbe247fa775a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:19:49.604299 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-0fccd98b-0038-47d2-aa03-6ffcb8ae7825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:19:49.613292 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 618/1235] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:19:49 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:19:58.737690 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=30 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:19:59.597514 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=9 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:00.411827 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:00.420830 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2064de3d-22ee-4c10-8f7c-8b580795c9fd service cinder] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:00.424419 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:00.425002 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:00.425276 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:00.425577 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:00.434658 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:00.436051 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:00.455686 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 618/1236] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:00.633105 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccd98b-0038-47d2-aa03-6ffcb8ae7825 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:00.643094 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccd98b-0038-47d2-aa03-6ffcb8ae7825 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:00.646617 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:00.647481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:00.647751 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:00.648016 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:00.657047 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:00.658677 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:00.668620 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 619/1237] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:00 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:10.452641 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=10 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:10.664345 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=6 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:20:16.440286 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:20:16.448844 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e61d2-3915-4e99-bf31-617cc5d1b346 service neutron] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:20:16.452451 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:20:16.453040 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:20:16.453312 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:20:16.453608 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:20:16.462319 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:20:16.463732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:20:16.471526 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 619/1238] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:20:16 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:20:26.468268 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=6 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:04.505489 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:04.519101 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc48bd-d3fb-4440-94b4-671c59e98edd service neutron] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:04.526494 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:04.528040 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:04.528320 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:04.529519 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:04.546664 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:04.548901 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:04.574911 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 620/1239] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:04 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:05.830786 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:05.842858 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a6818-a643-4188-9786-4451ae4dfa60 service neutron] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:05.847906 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c31d09-3b66-4b65-9a32-d2fda7a47096 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:05.848488 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31d09-3b66-4b65-9a32-d2fda7a47096 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:05.848762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31d09-3b66-4b65-9a32-d2fda7a47096 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:05.849091 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c31d09-3b66-4b65-9a32-d2fda7a47096 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:05.858683 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c31d09-3b66-4b65-9a32-d2fda7a47096 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:05.860283 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c31d09-3b66-4b65-9a32-d2fda7a47096 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:05.870800 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 620/1240] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:05 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:12.555405 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:12.566704 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff978027-1444-44aa-8b35-9ebaea831800 service nova] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:12.570312 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64281884-c932-4ed2-a910-a0e779c075d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:12.570902 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281884-c932-4ed2-a910-a0e779c075d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:12.571170 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281884-c932-4ed2-a910-a0e779c075d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:12.571509 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281884-c932-4ed2-a910-a0e779c075d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:12.641833 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64281884-c932-4ed2-a910-a0e779c075d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:12.643283 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64281884-c932-4ed2-a910-a0e779c075d2 service neutron] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:12.664138 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 621/1241] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:15.867086 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=6 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:16.468241 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c96d2-2a62-4d0a-8ac1-86c6e17a18b9 None None] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:16.468572 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c96d2-2a62-4d0a-8ac1-86c6e17a18b9 None None] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:16.468838 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c96d2-2a62-4d0a-8ac1-86c6e17a18b9 None None] PATH_INFO: `/` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:16.470402 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 621/1242] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 17 16:21:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 16:21:16.501523 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7453-98b5-45b8-bfb8-43a7e47af7ca None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:16.502022 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7453-98b5-45b8-bfb8-43a7e47af7ca None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:16.502022 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7453-98b5-45b8-bfb8-43a7e47af7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:16.584323 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-502c7453-98b5-45b8-bfb8-43a7e47af7ca None None] MFA Rules not processed for user `6772c5cbd29741078f90ea0aadb2ddbb`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:21:16.585843 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-502c7453-98b5-45b8-bfb8-43a7e47af7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:16.595480 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 622/1243] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 17 16:21:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:21:16.613417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c96d2-2a62-4d0a-8ac1-86c6e17a18b9 None None] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:16.628917 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c96d2-2a62-4d0a-8ac1-86c6e17a18b9 None None] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:16.634727 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6772c5cbd29741078f90ea0aadb2ddbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:16.635322 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:16.635599 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:16.635895 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:16.645360 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:16.647016 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:16.657432 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 622/1244] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:21:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:21:19.861935 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c7453-98b5-45b8-bfb8-43a7e47af7ca None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:19.877794 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c7453-98b5-45b8-bfb8-43a7e47af7ca None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:19.882468 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:19.883069 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:19.883346 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:19.883619 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] PATH_INFO: `/v3/users/a87f7d1d1b074ef9a67f6bffc273c8e7` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:19.884740 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a87f7d1d1b074ef9a67f6bffc273c8e7)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:19.886878 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:19.943610 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a87f7d1d1b074ef9a67f6bffc273c8e7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:19.952397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a87f7d1d1b074ef9a67f6bffc273c8e7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:19.964765 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a87f7d1d1b074ef9a67f6bffc273c8e7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:19.978691 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a87f7d1d1b074ef9a67f6bffc273c8e7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:19.979300 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a87f7d1d1b074ef9a67f6bffc273c8e7'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:19.987361 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 623/1245] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 17 16:21:19 2022] DELETE /identity/v3/users/a87f7d1d1b074ef9a67f6bffc273c8e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:20.179885 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:20.192161 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544ad05-ea9a-4020-bb31-deea88621ed4 service placement] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:20.267417 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:20.268051 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:20.268328 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:20.268600 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] PATH_INFO: `/v3/projects/e549d71c421e49a5ba8af403f82bb900` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:20.269769 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e549d71c421e49a5ba8af403f82bb900)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:20.271707 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:20.320073 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e549d71c421e49a5ba8af403f82bb900', 'request_id': 'req-72a2d41c-0a35-4621-bd26-983844b0133a'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.326510 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e549d71c421e49a5ba8af403f82bb900', 'request_id': 'req-72a2d41c-0a35-4621-bd26-983844b0133a'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.335569 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e549d71c421e49a5ba8af403f82bb900', 'request_id': 'req-72a2d41c-0a35-4621-bd26-983844b0133a'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.347606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] The token cache is being invalidate because project e549d71c421e49a5ba8af403f82bb900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:21:20.347888 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.348697 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.350215 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 623/1246] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 17 16:21:20 2022] DELETE /identity/v3/projects/e549d71c421e49a5ba8af403f82bb900 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:20.354327 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:20.355722 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:20.365772 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:20.369787 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0fe72-53a6-4610-9afd-7a180a6e9ddc admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:20.433426 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:20.434059 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:20.434336 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:20.435118 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] PATH_INFO: `/v3/users/bb52f4d6f5da47e49b016be9deb9dd3f` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:20.436599 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb52f4d6f5da47e49b016be9deb9dd3f)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:20.438550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:20.500053 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb52f4d6f5da47e49b016be9deb9dd3f'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.506972 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb52f4d6f5da47e49b016be9deb9dd3f'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.519402 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb52f4d6f5da47e49b016be9deb9dd3f'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.527429 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb52f4d6f5da47e49b016be9deb9dd3f'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.528138 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-c3c80759-d8a7-42ed-993f-ed46729fe80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb52f4d6f5da47e49b016be9deb9dd3f'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.538387 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 624/1247] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 17 16:21:20 2022] DELETE /identity/v3/users/bb52f4d6f5da47e49b016be9deb9dd3f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:21:20.740085 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:21:20.741676 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:21:20.757470 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2d41c-0a35-4621-bd26-983844b0133a admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:21:20.829982 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:21:20.830616 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:21:20.830899 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:21:20.831172 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] PATH_INFO: `/v3/projects/7046b9cf26624144902873c4682814f4` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:21:20.832324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7046b9cf26624144902873c4682814f4)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:21:20.834302 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:21:20.856197 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:20.889626 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7046b9cf26624144902873c4682814f4', 'request_id': 'req-43c71314-d721-4c77-90c7-ea68dd7cc5aa'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.895161 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7046b9cf26624144902873c4682814f4', 'request_id': 'req-43c71314-d721-4c77-90c7-ea68dd7cc5aa'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.903176 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7046b9cf26624144902873c4682814f4', 'request_id': 'req-43c71314-d721-4c77-90c7-ea68dd7cc5aa'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.917579 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] The token cache is being invalidate because project 7046b9cf26624144902873c4682814f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:21:20.917869 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.918546 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:21:20.920324 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 624/1248] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 17 16:21:20 2022] DELETE /identity/v3/projects/7046b9cf26624144902873c4682814f4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:21:30.531397 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=51,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:21:30.914740 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:01.537913 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] REQUEST_METHOD: `POST` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:01.538486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:01.538486 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:01.558000 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.auth.core [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] MFA Rules not processed for user `572057fc5af44b4fa2fccbe247fa775a`. Rule list: `[]` (Enabled: `True`). {{(pid=88431) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 16:22:01.559268 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:01.624957 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 625/1249] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 17 16:22:01 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 16:22:01.982320 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:22:01.983893 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:02.042959 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c71314-d721-4c77-90c7-ea68dd7cc5aa admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:22:02.046669 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:22:02.047276 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:02.047554 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:02.047823 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:02.050006 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:02.060783 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:22:02.062275 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:22:02.070762 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 625/1250] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:22:01 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:22:02.532628 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:22:02.534064 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:02.613422 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ff821-c585-47dc-a456-6c828deed7b6 None None] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:22:02.619180 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6772c5cbd29741078f90ea0aadb2ddbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:22:02.619897 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:02.620243 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:02.620546 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:02.624134 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:02.636066 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:22:02.638175 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:22:02.648857 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 626/1251] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:22:02 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:22:11.058009 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:22:11.060241 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:11.135374 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42467b9e-e97c-4974-b249-eb34ec3f8cb8 service neutron] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:22:11.141272 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae7640a3956e449ebeb41f45eb56aeda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:22:11.141897 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:22:11.142170 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:22:11.142437 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:22:11.144110 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:22:11.155926 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:22:11.157496 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:22:11.166878 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 626/1252] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:22:11 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:22:12.644327 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=57 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:22:21.163016 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=58 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:09.935962 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:09.937591 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:10.003994 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6287c3-253b-456a-ad7a-1f37cf3b9bbe service placement] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:10.009069 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6772c5cbd29741078f90ea0aadb2ddbb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:10.009695 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] REQUEST_METHOD: `GET` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:10.009970 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:10.010237 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:10.011954 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:10.024872 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:10.026520 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:10.036693 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 627/1253] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:20.032481 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=28 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:37.394366 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:37.396476 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:37.462866 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8780991-1862-4894-bbb5-c4f7426acda5 service nova] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:37.466663 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30a70853ec1d420b9533cf1d056e170b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d3887437d064297aba3a0bf12f93d78', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:37.467259 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:37.467530 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:37.467796 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:37.469606 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:37.607607 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:37.608955 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:37.619483 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 627/1254] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 17 16:24:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 16:24:46.088850 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.090357 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.104899 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30db985-ff1c-42bb-8dc5-45106cca9893 service placement] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.110205 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.111284 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.112037 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.112504 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] PATH_INFO: `/v3/users/572057fc5af44b4fa2fccbe247fa775a` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.142407 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=572057fc5af44b4fa2fccbe247fa775a)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.147655 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.208865 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '572057fc5af44b4fa2fccbe247fa775a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.220550 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '572057fc5af44b4fa2fccbe247fa775a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.235683 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '572057fc5af44b4fa2fccbe247fa775a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.246524 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '572057fc5af44b4fa2fccbe247fa775a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.247338 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '572057fc5af44b4fa2fccbe247fa775a'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.258942 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 628/1255] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:46 2022] DELETE /identity/v3/users/572057fc5af44b4fa2fccbe247fa775a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:46.487403 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.501750 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f075ff-56e6-466b-ba5f-36ad2a3127d0 service neutron] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.573753 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.574391 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.574668 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.574940 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] PATH_INFO: `/v3/projects/fc255fcabea342ee9e0dcca985cac63f` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.587020 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc255fcabea342ee9e0dcca985cac63f)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.588951 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.628208 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:46.647704 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc255fcabea342ee9e0dcca985cac63f', 'request_id': 'req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.654681 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc255fcabea342ee9e0dcca985cac63f', 'request_id': 'req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.665082 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc255fcabea342ee9e0dcca985cac63f', 'request_id': 'req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.682119 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] The token cache is being invalidate because project fc255fcabea342ee9e0dcca985cac63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:46.682386 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.683045 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.684511 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 628/1256] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:46 2022] DELETE /identity/v3/projects/fc255fcabea342ee9e0dcca985cac63f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 16:24:46.688663 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Authenticating user token {{(pid=88431) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:46.691395 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.fernet_utils [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88431) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:46.707001 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463e324-d58b-4e5d-85e9-27294bd83394 admin admin] Validating token access rules against request {{(pid=88431) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:46.792172 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88431) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:46.792701 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:46.792997 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] SCRIPT_NAME: `/identity` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:46.793251 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] PATH_INFO: `/v3/users/c270b8246380472cadd5da9610028531` {{(pid=88431) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:46.811274 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c270b8246380472cadd5da9610028531)` {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:46.813274 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] RBAC: Authorization granted {{(pid=88431) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:46.871304 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c270b8246380472cadd5da9610028531'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.877855 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:46.881209 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c270b8246380472cadd5da9610028531'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.900875 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c270b8246380472cadd5da9610028531'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.912762 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c270b8246380472cadd5da9610028531'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.913640 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG keystone.notifications [None req-306c97a0-7383-4ad7-bee8-53c5bf34193a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c270b8246380472cadd5da9610028531'} {{(pid=88431) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:46.921070 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: [pid: 88431|app: 0|req: 629/1257] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 17 16:24:46 2022] DELETE /identity/v3/users/c270b8246380472cadd5da9610028531 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:47.153712 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Authenticating user token {{(pid=88432) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 16:24:47.153712 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.fernet_utils [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88432) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 16:24:47.169120 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6e2e7-5b43-4333-a5fe-09bf5589ce5c admin admin] Validating token access rules against request {{(pid=88432) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 16:24:47.265732 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6faffef1254eafa180a1020d50a19a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35b16f4dab55413091c1b8347836e133', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88432) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 16:24:47.266373 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 16:24:47.266646 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 16:24:47.266913 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] PATH_INFO: `/v3/projects/253326043068470b8bd683dac1202b26` {{(pid=88432) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 16:24:47.279422 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=253326043068470b8bd683dac1202b26)` {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 16:24:47.281663 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] RBAC: Authorization granted {{(pid=88432) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 16:24:47.341581 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253326043068470b8bd683dac1202b26', 'request_id': 'req-d654628f-fa88-4893-bc5f-192f690f5dfa'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:47.349343 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253326043068470b8bd683dac1202b26', 'request_id': 'req-d654628f-fa88-4893-bc5f-192f690f5dfa'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:47.363774 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253326043068470b8bd683dac1202b26', 'request_id': 'req-d654628f-fa88-4893-bc5f-192f690f5dfa'} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:47.388512 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] The token cache is being invalidate because project 253326043068470b8bd683dac1202b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88432) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 16:24:47.388795 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:47.389494 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG keystone.notifications [None req-d654628f-fa88-4893-bc5f-192f690f5dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88432) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 16:24:47.390994 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: [pid: 88432|app: 0|req: 629/1258] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 17 16:24:47 2022] DELETE /identity/v3/projects/253326043068470b8bd683dac1202b26 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 16:24:56.916748 dv-osbrick-836057-4-ceph devstack@keystone.service[88431]: DEBUG dbcounter [-] [88431] Writing DB stats keystone:SELECT=10,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 16:24:57.381825 dv-osbrick-836057-4-ceph devstack@keystone.service[88432]: DEBUG dbcounter [-] [88432] Writing DB stats keystone:SELECT=69,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}